Browse DevOps & SRE Jobs
Search 200 curated tech job listings scraped in real-time from LinkedIn, Glassdoor, RemoteOK, and more. Filter by role, location, seniority, and source to find your next opportunity.
200 jobs found for "LLM"
Page 1 of 10
Software Engineer, Machine Learning Infrastructure
…visual models served roughly 72% cheaper). We also own core platform surfaces including the LLM Gateway, Agent Gateway, evals infrastructure, guardrails, and cost attribution. About The Role You will join a small … stack — real-time GPU endpoints, high-throughput batch inference, and fine-tuning (SFT/DPO/LoRA) — alongside the LLM Gateway, Agent Gateway, evals infrastructure, guardrails, and cost attribution. Design scalable, high-performance systems for model…
Artificial Intelligence Engineer
…real customer and commercial impact. Develop our GenAI capabilities: Use and extend our shared LLM tooling for classification, enrichment, structured outputs and evaluation, and help deliver roadmap capabilities such as retrieval-augmented … architectures by weighing quality, latency and cost, apply FinOps practices to keep our cloud and LLM spend visible and under control, and make sure features earn their keep. Provide technical leadership: Partner…
Site Reliability Engineer
…that enables AI agents to run safely and reliably in production Develop secure isolation layers, LLM gateways, workflow monitoring, anomaly detection, and production telemetry Help define CI/CD for an agent-driven engineering … rate limiting, permission scoping, auditability, and safety controls Familiarity with OpenClaw, agent orchestration frameworks, or LLM gateway patterns is a plus Hands-on experience with GCP Workflows for orchestration Familiarity with Prisma…
DevOps Engineer - Agentic AI Platform
…agentic workloads run on—the Kubernetes, GitOps, identity, and gateway layers that let LLM-powered services ship and scale safely. Second, you'll bring AI into how we run operations itself—using … gateway layers that AI and agentic services depend on—built so teams can ship LLM-powered features safely Apply AI to DevOps itself: build and operate agent-assisted automation that reduces toil…
Senior DevOps Engineer
…Senior Software Engineer (Golang) Senior DevOps Engineer Senior Site Reliability Engineer Platform Engineer Senior Python & LLM Developer Why this one's worth a look: Starts as contract work through our platform … Golang 5+ years of experience with Kubernetes AI-assisted coding is a must Senior Python + LLM Developer 5+ years of software development experience 5+ years of experience with Python 2+ years…
Python/GenAI Solutions Architect
…only or POC only backgrounds will not be considered Production experience with RAG systems and LLM based agentic workflows that are live and running, not prototypes Backend development experience with Flask, Django … with AWS (SageMaker, Bedrock, Lambda, ECS, S3, SQS, ECR, or similar); GCP considered Experience with LLM APIs (OpenAI, Anthropic Claude, or AWS Bedrock) Strong Python proficiency: OOP, design patterns, clean architecture…
Cloud Reliability Engineer (SRE)
…fixed target — it's a property we continually push forward, increasingly with agentic and LLM-assisted workflows driving triage, root-cause analysis, and remediation. This is a role for someone who likes … teams use AI in operations — choosing where agentic and LLM-assisted tooling adds real leverage, and where human judgment must stay in the loop. What You Need To Succeed…
Forward Deployment Engineer
…maintainable code; able to read, debug, and extend existing agentic system code written by others. LLM Integration: Working knowledge of LLM integration patterns: prompt engineering, RAG basics, function calling; experience with … least one major LLM provider. Data Engineering & System Integrations: SQL proficiency; experience building system integrations connecting AI solutions to enterprise data sources (CRM, ticketing, ERP, billing); able to build lightweight ETL/ELT pipelines…
Staff Infrastructure Engineer
…Support agent infrastructure: Help design and run the compute layer for our coding agents and LLM workloads. Mentor: Grow the engineers on the team who've been doing infrastructure work part-time … Codex, or similar in your own work, and you have opinions about what infrastructure for LLM and agent workloads should look like. Nice To Have Experience operating Rails, Sidekiq, or another stateful…
Software Engineer, SRE
…including service instrumentation with OpenTelemetry and improved logging practices. You will leverage AI tools and LLM platforms in your daily work to reduce toil, drive autonomous operations, and optimise system health, while … paramount importance to the business. An AI-native engineering approach, with hands-on experience using LLM platforms and coding assistants to improve productivity and quality, and the ability to integrate AI-driven…
Forward Deployed Engineer
…setup, troubleshooting, and data acquisition Build and own evaluation frameworks to continuously measure and improve LLM performance across customer deployments Contribute feedback and insights that shape product and platform improvements Work closely … Computer Science, Engineering, or similar 3+ years of professional Python experience Experience designing and running LLM evals (offline and online) to measure model quality and performance. Comfortable working with relational databases, APIs…
Software Engineer, SRE
…including service instrumentation with OpenTelemetry and improved logging practices. You will leverage AI tools and LLM platforms in your daily work to reduce toil, drive autonomous operations, and optimise system health, while … paramount importance to the business. An AI-native engineering approach, with hands-on experience using LLM platforms and coding assistants to improve productivity and quality, and the ability to integrate AI-driven…
DevOps Engineer
…webhooks that review PRs, report compliance drift, page on-call, and provision access. Several are LLM-backed on Amazon Bedrock. You'll ship these, not just consume them. Improve CI/CD: GitHub Actions … bootstrapping. Data platform exposure: Glue, Athena, QuickSight, Lake Formation, DMS. Amazon Bedrock or other LLM API work—we build with Claude and are actively expanding internal AI tooling. Windows Server administration…
Platform Engineer (DevOps)
…have: Observability (OpenTelemetry, Grafana, ELK, New Relic) GitOps (ArgoCD or Flux) Airflow, SageMaker or MLflow LLM infrastructure such as inference serving, evals and LLM/ MCP gateways SecOps, container scanning (Checkov, Trivy) & secrets…
Infrastructure Engineer
…system produces them, not because someone remembered. Own cost as an engineering surface — per-key LLM and infrastructure spend, estimated-versus-billed reconciliation, and alerting that fires before a runaway job becomes … companies onto a single platform. Data warehouse pipelines (Redshift, BigQuery, Snowflake) and event-ingestion plumbing. LLM infrastructure: gateways and virtual keys, provider rate limits, token and spend telemetry. Secrets management at scale…
Site Reliability Engineer
…that enables AI agents to run safely and reliably in production Develop secure isolation layers, LLM gateways, workflow monitoring, anomaly detection, and production telemetry Help define CI/CD for an agent-driven engineering … rate limiting, permission scoping, auditability, and safety controls Familiarity with OpenClaw, agent orchestration frameworks, or LLM gateway patterns is a plus Hands-on experience with GCP Workflows for orchestration Familiarity with Prisma…
GenAI Platform Engineer (Python, MCP & Agentic AI)
…production-ready environment. The ideal candidate will have deep expertise in Python, GenAI architectures, LLM orchestration frameworks, MCP implementations, API development, cloud-native services, and financial data integrations . Key Responsibilities Design, develop … equivalent experience). Strong hands-on experience with Python backend development. Proven experience building GenAI applications, LLM workflows, agentic systems, or AI-powered platforms. Experience with MCP concepts and implementations, including tools, resources…
Site Reliability Engineer
…surface issues faster and improve operational control. The role also includes using AI tools, LLM platforms and coding assistants to boost productivity, support autonomous operations and improve system insight. Working across … large-scale, 24/7 enterprise where uptime, performance and stability are critical. Practical experience using LLM platforms and coding assistants safely to improve productivity, quality and root-cause analysis. Additional Information Develop…
Senior Engineer
…documentation and infrastructure as code. Create evaluation, monitoring and observability for data quality, model or LLM behaviour, service reliability, performance and cost. Protect sensitive data and apply appropriate security, privacy, governance … experience with Databricks Experience deploying secure, scalable workloads on AWS. Understanding of applied AI and LLM patterns such as retrieval-augmented generation, tool use, structured extraction and evaluation. Effective…
DevOps Engineer
…webhooks that review PRs, report compliance drift, page on-call, and provision access. Several are LLM-backed on Amazon Bedrock. You'll ship these, not just consume them. Improve CI/CD: GitHub Actions … bootstrapping. Data platform exposure: Glue, Athena, QuickSight, Lake Formation, DMS. Amazon Bedrock or other LLM API work—we build with Claude and are actively expanding internal AI tooling. Windows Server administration…