Browse Data & ML Jobs
Search 163 curated tech job listings scraped in real-time from LinkedIn, Glassdoor, RemoteOK, and more. Filter by role, location, seniority, and source to find your next opportunity.
163 jobs found for "Apache"
Page 1 of 9
Principal Software Engineer - Big Data & Java
…scalable distributed systems based on Java microservices Engineer and optimize data pipelines using solutions like Apache Hudi, Apache Trino, Azure ADLS Collaborate cross-functionally with product, analytics, and AI teams to ensure … scalability across batch and streaming environments Proven experience with Lakehouse architectures and related technologies, including Apache Hudi, Azure ADLS Gen2, HDFS, and other big data technologies (Trino, Databricks, Spark) Strong collaboration…
Sales Engineer, EMEA
…life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data … DataOps a first-class discipline in every modern data organization. As the driving force behind Apache Airflow, we're powering mission-critical pipelines at scale for companies like Condé Nast, Rappi, Sonos…
Principal Data Engineer
…what it costs to operate . Hands-on experience with event streaming platforms such as Apache Kafka for extremely high-throughput, low-latency ingestion. Hands-on experience with both managed data … equivalents (such as Spark, Trino, ClickHouse , and lake house table formats like Delta Lake or Apache Iceberg). Strong proficiency in Python and SQL, with distributed processing frameworks such as Apache Spark…
Big Data Engineer
…data engineering. Lakehouse Architecture: Demonstrate strong expertise in managing, creating, and optimizing Delta Lake or Apache Iceberg tables. Secure Data Management: Apply security-by-design, data governance, and compliance best practices across … least one data lake platform among Databricks, Snowflake, or AWS Redshift. Strong expertise in Apache Spark (creation, handling, and monitoring of pipelines) and lakehouse table formats (Delta Lake or Apache Iceberg). Strong…
Full Stack JavaScript Developer (Data and Search Focus) - TS Required
…with maintaining and monitoring real-time Change Data Capture (CDC) and streaming data pipelines (Debezium, Apache Kafka, Apache Flink, Vector) that feed system search engines. Support the integration of semantic/vector search features … vector databases (OpenSearch k-NN), semantic search, or AI model integration. Hands-on exposure to Apache Flink or Vector data routers. Experience with OpenTelemetry, Grafana, Redis caching, and authentication patterns (OAuth2/OIDC, Keycloak…
Staff Data Engineer
…pipelines, using open source and public cloud technologies. Strong experience with data orchestration tools: e.g. Apache Airflow, Dagster. Experience with big data storage and processing technologies: e.g. DBT, Spark, SQL, Athena/Trino, Redshift … Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event-driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. Experience with public cloud environments: e.g. AWS, GCP, Azure, Terraform. Strong knowledge of software…
Data Engineer
…Entwicklung von Big Data Pipelines basierend auf Databricks Entwicklung von Real Time Applikationen basierend auf Apache Kafka Aufbau von Datalake inklusive Data processing auf basis von dbt tools Unterstützung im Konzeptions … Erfahrung Du hast Fachwissen in einer der verschiedenen Programmiersprachen / Frameworks: Java / Scala Python Spring Boot / Apache Spark / Apache Airflow Bash / Ansible / ssh / RSA Keys / Networking Azure Cloud DBT / Databricks Benefits Zwei Tage…
Senior Data Engineer - Real time analytics New
…actionable feedback. Our tech. stack: AWS (Kinesis,Kafka, s3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink and Airflow. A continuous deployment process based on GitLab A little more about…
10607 - Senior Data Engineer (Python) New
…ideal candidate will have strong experience in Python-based data engineering, workflow orchestration using Apache Airflow, and building scalable data solutions using Lakehouse and Medallion Architecture (Bronze, Silver, Gold) principles. In this … ingesting, processing, and transforming large volumes of data. Build and manage data workflows using Apache Airflow, including scheduling, monitoring, alerting, and troubleshooting production jobs. Implement and support Medallion Architecture (Bronze, Silver, Gold…
Principal Data Engineer
…consumer-aligned patterns. Proven ability to architect and scale modern cloud data platforms using Snowflake, Apache Iceberg, Amazon Redshift, and S3. Hands-on expertise in developing robust data transformation pipelines and orchestrating … complex workflows using dbt and Apache Airflow. Strong track record of automating infrastructure and deployment pipelines using Infrastructure as Code tools like Terraform and GitHub Actions. Ability to implement data governance, technical…
Senior Data Engineer - Real time analytics
…actionable feedback. Our tech. stack: AWS (Kinesis,Kafka, s3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink and Airflow. A continuous deployment process based on GitLab A little more about…
Senior Data Engineer - Real time analytics
…actionable feedback. Our tech. stack: AWS (Kinesis,Kafka, s3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink and Airflow. A continuous deployment process based on GitLab A little more about…
Senior Python Dev + Data Engineer IRC306110
…Python programming language. Strong SQL skills and experience with relational and analytical databases. Experience with Apache Spark and distributed data-processing frameworks. Experience with cloud data platforms, preferably Google Cloud Platform … BigQuery or Azure Synapse. Experience with orchestration tools such as Apache Airflow. Knowledge of software development best practices, including version control, testing, CI/CD, and Agile delivery. Demonstrated, hands-on experience using approved…
Python Lead
…with complex data scenarios Data Processing Libraries: Proficiency with Polars, PyArray, Parquet, wheels, Pandas, NumPy, Apache Spark (PySpark), Dask, or similar frameworks AI Tools: Experience using AI-powered development tools (GitHub Copilot … ChatGPT, etc.) for code generation, debugging, and optimization Secondary Apache Kafka: Experience with real-time data streaming and message processing Oracle & SQL: Strong database skills with complex query optimization Kubernetes: Container orchestration…
Data Scientist
…streamline data science pipelines like amazon web services, python scripting language, PostgreSQL database and Apache Spark. Develop code infrastructure to enable continuous improvement, continuous development pipeline. Prepare documentation and visualization for team … Advanced skills in SQL and Python Knowledge of Amazon Web Services, Microsoft Azure Cloud, and Apache Spark. Ability to communicate highly technical results and methods to both technical and non-technical audiences…
Systems Programmer Analyst l – Java
…Experience developing REST web services and enterprise application integrations. Knowledge of application containers such as Apache Tomcat. Familiarity with Docker and Kubernetes or OpenShift. Experience with unit testing, continuous integration, refactoring … Nice To Have Experience with modern web and integration technologies, including Angular, TypeScript, Node.js, JavaScript, Apache Kafka, and related frameworks. Experience contributing to architecture, modernization, automation, or technical-improvement initiatives. Interest…
Senior Data Engineer - Real time analytics
…actionable feedback. Our tech. stack: AWS (Kinesis,Kafka, s3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink and Airflow. A continuous deployment process based on GitLab A little more about…
Software Engineer - GEN AI
…scalability. Contribute to the development and maintenance of AI workflows and data pipelines using Apache Airflow. Participate in code reviews, testing activities, and continuous improvement initiatives. Document technical solutions and support knowledge … Gateway, and RDS. Basic knowledge of infrastructure-as-code concepts and CloudFormation. Experience with Apache Airflow or similar workflow orchestration platforms. Understanding of GenAI application patterns such as Retrieval-Augmented Generation…
Systems Programmer Analyst l - Java
…stored procedures, and data modeling experience. Knowledge and work experience with application containers such as Apache Tomcat Focus on quality development (unit testing, Continuous Integration, refactoring, clean code) Familiarity with cloud … stored procedures, and data modeling experience. Knowledge and work experience with application containers such as Apache Tomcat Focus on quality development (unit testing, Continuous Integration, refactoring, clean code) Familiarity with cloud…
Senior Data Engineer - Real time analytics
…actionable feedback. Our tech. stack: AWS (Kinesis,Kafka, s3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink and Airflow. A continuous deployment process based on GitLab A little more about…