Browse Data & ML Jobs
Search 168 curated tech job listings scraped in real-time from LinkedIn, Glassdoor, RemoteOK, and more. Filter by role, location, seniority, and source to find your next opportunity.
168 jobs found for "Kafka"
Page 1 of 9
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
…Microsoft Azure, Google Cloud) 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL) 4+ year experience working on real-time data and streaming applications 4+ years…
Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI)
…Microsoft Azure, Google Cloud) 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL) 4+ year experience working on real-time data and streaming applications 4+ years…
Software Developer, Data Platform
…management of a comprehensive suite of services, tools and platforms, utilising technologies such as Golang, Kafka, Flink, GCP, Spanner and BigQuery. This role is eligible for inclusion in the Company’s hybrid … work from home policy. Qualifications Proficiency in Golang and/or Python. Background in using Apache Kafka. Familiarity with high-volume transactional environments. Track record of developing low-latency, highly available and scalable solutions…
Software Developer, Data Platform
…management of a comprehensive suite of services, tools and platforms, utilising technologies such as Golang, Kafka, Flink, GCP, Spanner and BigQuery. This role is eligible for inclusion in the Company’s hybrid … work from home policy. Qualifications Proficiency in Golang and/or Python. Background in using Apache Kafka. Familiarity with high-volume transactional environments. Track record of developing low-latency, highly available and scalable solutions…
Python Data Engineer with PySpark and Pytest
…services using Django and Flask. Design and manage MongoDB databases, schemas, indexes, and queries. Develop Kafka producers and consumers for real-time data processing. Implement data transformation, validation, cleansing, and integration workflows … Experience in Python development and data engineering. Strong knowledge of Python, PySpark, Django, Flask, MongoDB, Kafka, and Pytest. Experience with REST APIs, ETL/ELT pipelines, and distributed data processing. Proficiency…
Senior Data Engineer - Real time analytics
…monitoring Mentor team members through giving and receiving actionable feedback. Our tech. stack: AWS (Kinesis,Kafka, s3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink and Airflow. A continuous deployment … modeling (star schema, dimensional modeling etc) in AWS redshift Experience of query optimisation Experience of kafka is a plus Shipping and maintaining code in production You like sharing your ideas…
Senior Data Engineer - Real time analytics
…monitoring Mentor team members through giving and receiving actionable feedback. Our tech. stack: AWS (Kinesis,Kafka, s3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink and Airflow. A continuous deployment … modeling (star schema, dimensional modeling etc) in AWS redshift Experience of query optimisation Experience of kafka is a plus Shipping and maintaining code in production You like sharing your ideas…
Java AI Lead Software Engineer
…distributed systems using Java Strong knowledge in Core Java (Java 21+), Spring Boot, React, REST, Kafka, Microservices, Agile, DevOps Hands-on practical experience using AI coding assistants (GitHub Copilot, Cursor, Claude … Experience working with cloud platforms such as AWS Experience on asynchronous communication using messaging/streaming systems (Kafka, RabbitMQ, or equivalents) Ability to design and optimize data models either in relational or NoSQL databases…
Gen AI Engineer
…workflows. ________________________________________ Required Skills & Experience Primary Skill: Python Secondary Skills: Vector DB, Django, Flask, FastAPI, KAFKA, Containerization (OpenShift, Docker etc.) Knowledge in GenAI lifecycle management and RAG pipelines. Expertise in prompt engineering … FastAPI, containerization (Docker/Kubernetes), and API integrations. Understanding of DevOps practices and enterprise tooling. Understanding of Kafka queue integration and configurations. Ability to deploy python code on to containers using OpenShift and docker…
Principal Data Engineer
…team Design and operate real-time and near-real-time pipelines using streaming technologies (Kafka, Confluent Cloud, Fabric Eventstreams) â and know when streaming is the right answer and when … environment Exposure to MDM platforms (Profisee, Semarchy, Ataccama, or equivalent) Experience with Confluent Cloud / Apache Kafka for streaming ingestion into Fabric or Synapse Familiarity with cross-tenant Azure / Fabric architecture Background…
Senior Data Engineer - Real time analytics
…monitoring Mentor team members through giving and receiving actionable feedback. Our tech. stack: AWS (Kinesis,Kafka, s3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink and Airflow. A continuous deployment … modeling (star schema, dimensional modeling etc) in AWS redshift Experience of query optimisation Experience of kafka is a plus Shipping and maintaining code in production You like sharing your ideas…
Software Engineer, Backend - AI Practice Team
…profiling, caching, and query optimization. Stream real-time data: Engineer high-throughput pipelines using Apache Kafka and other event streaming platforms. Deliver reliability: Establish strong observability, testing, and monitoring practices to guarantee … backend development. Deep experience with event-driven architectures and real-time streaming, particularly Apache Kafka. Mastery of distributed system patterns (CQRS, Event Sourcing, Saga, Circuit Breaker, Bulkhead). Strong command of performance optimization…
AI Engineer – Agentic AI
…and/or GCP, Kubernetes APIs and services: REST, gRPC Distributed systems: event-driven architectures, including Kafka Orchestration Frameworks: LangGraph, LangChain, AirFlow, etc Agentic AI and ML Integration of commercial and open-source LLMs … architectures. Strong understanding of event-driven programming and distributed systems. Hands-on experience with Apache Kafka and messaging platforms. Experience working with Enterprise Data Hubs and data integration platforms. Strong PostgreSQL database…
Python Software Engineer - AI Security Platform (m/f/n)
…Familiarity with modern software development workflows. Desirable Requirements Experience with Docker and Kubernetes. Experience with Kafka, Celery, or similar messaging and task-queue technologies. Experience with cloud platforms (AWS, Azure). Knowledge … Previous experience in cybersecurity, threat detection, or high-volume data processing. Technologies Python, FastAPI, Celery, Kafka, MongoDB, Redis, gRPC, Envoy, Hadoop, Spark, Impala, Azure, Docker, Kubernetes, Helm, Kubeflow, Argo, Jenkins, Git, JIRA…
Staff Data Engineer
…reviews, documentation, and hands-on collaboration. 💻 What you will be working with/on GCP Pub/Sub and Kafka Apache Beam Bigtable Redis Kubernetes Airflow BigQuery Terraform Python and SQL Real-time and batch processing … processing systems Deep knowledge of real-time and event-driven architectures using technologies such as Kafka or Pub/Sub. A track record of leading complex technical initiatives that span multiple teams or domains…
Data Engineer - Newcastle
…Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real‑time streaming pipelines and event‑driven integrations. Integrate data from … programming proficiency in Java (preferred) or Python. Hands-on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state…
Java/Python DB Developer
…scripts (Shell, Python), les outils de planification (Autosys, Cron, Airflow) et les systèmes de messagerie (Kafka, IBM MQ). Nous Offrons Une organisation multinationale avec 58 bureaux dans 22 pays et la possibilité … REST APIs, Microservices, MongoDB, scripting (Shell, Python), scheduling tools (Autosys, Cron, Airflow), and messaging systems (Kafka, IBM MQ). We Offer A multinational organization with 58 offices in 22 countries and the possibility…
Python AI Engineer
…pipelines and utilities using Python. Java, API, Python, Cloud, Microservice based architecture, Spring boot, Vertex, Kafka, RDBMS, No SQL, Maven, GIT, Jenkins, CI/CD Python, AI/ML, Tensorflow, LLM, GenAI Implement efficient data ingestion … SQLAlchemy, Alembic, and ORM frameworks. Familiarity with Airflow or Prefect for workflow orchestration. Exposure to Kafka or RabbitMQ for messaging. Knowledge of FastAPI or Flask for API development. Prior experience in BFSI…
Data Engineer
…doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda … data platforms (3+ years) • Proficiency in Java or Python • Hands-on experience with streaming technologies (Kafka / Flink preferred) • Good understanding of distributed systems and cloud platforms (AWS ideally) • Experience with CI/CD, Docker…
Software Developer – Java, AWS & PL/SQL (AI-Assisted Development) New
…React or Angular Architecture: Microservices, APIs, event-driven systems Data: Oracle Infrastructure: AWS/Azure, Docker, Kubernetes, Kafka Tools: CI/CD pipelines, observability platforms Must-Have Skills 3–7 years of experience in backend/full-stack development…