Software Engineer

Title: Software Engineer Industry: Autonomous Vehicle/Tech Location: Foster City, CA Duration: ~6 Months Responsibilities Build and maintain the Python/FastAPI backend powering high-throughput embedding search, bulk execution APIs, and dataset management endpoints. Develop and enhance dashboards and data visualization tools for data introspection and ad-hoc reporting. Implement observability and monitoring to ensure platform reliability and data-driven iteration. Design, build, and maintain Airflow DAGs for end-to-end dataset creation and refresh pipelines. Optimize data processing performance and pipeline reliability. Requirements 3+ years of professional software engineering experience with a focus on data processing and pipeline engineering. Experience designing, building, and optimizing distributed data processing pipelines at scale using technologies like Spark, Databricks, AWS EMR, AWS Batch, or Ray Core/Data. Strong proficiency in Python, particularly with FastAPI or similar async frameworks. Experience maintaining data visualization dashboards, with proficiency in SQL and familiarity with PySpark/Scala. Familiarity with workflow orchestration tools (Airflow, Prefect, Dagster, or similar). Skills Software Engineering Data Processing Pipeline Engineering Python FastAPI Airflow Data Visualization AWS Distributed Systems Machine Learning Hourly rate is commensurate with experience and is an estimated range provided by WorkGenius. ref_id: 0d4b04c1-49bb-4967-a9d0-e0069488bf2c