Browse DevOps & SRE Jobs
Search 186 curated tech job listings scraped in real-time from LinkedIn, Glassdoor, RemoteOK, and more. Filter by role, location, seniority, and source to find your next opportunity.
186 jobs found for "LLM"
Page 1 of 10
Business Systems Engineer
…just maintain existing workflows, you'll actively advance our GTM systems with intelligent agents, LLM-powered automations, and next-generation integration patterns built on MCP, ClickUp Super Agents, and modern iPaaS tooling … eliminate manual effort and accelerate business operations. Develop and deploy ClickUp Super Agents and LLM-based automations to automate tasks such as deal data enrichment, quote generation assistance, order validation, revenue recognition…
AI Infrastructure Engineer, Serving Platform
…systems for serving LLMs and other models at scale. Build an internal platform to empower LLM capability discovery. Collaborate with researchers and engineers to integrate and optimize models for production and research … Strong programming skills in one or more languages (e.g., Python, Go, Rust, C++). Experience with LLM serving and routing fundamentals (e.g. rate limiting, token streaming, load balancing, budgets, etc.) Experience with LLM…
Ingénieur DevOps confirmé F/H
…salle héberge des racks NVIDIA GB200/300NVL72, sur lesquels tournent des workloads d'entraînement, d'inférence LLM et des environnements de développement pour les équipes data science. À cette échelle, la valeur … participation à l'élaboration des processus d'amélioration des performances des modèles spécifiques et des LLM en production (campagnes de benchmark de débit et de latence, mesure de l'utilisation GPU, tuning…
(Senior) AI Platform Engineer
…Azure ML/Azure OpenAI/Azure AI Foundry) und deren Integration mit Kubernetes-Workloads. Kenntnisse im Betrieb von LLM-basierten Architekturen, z. B. RAG-Pipelines, Vektordatenbanken und Embedding-Services sowie Agentic-AI-Ansätze und Model … Context Protocol (MCP). Verständnis von System-Level-Grundlagen des LLM-Servings (Rate Limiting, Token Streaming, Load Balancing) und LLM-Konzepten wie Reasoning, Tool Calling und Prompt Templates. Erfahrung mit neuen Serving-Bausteinen…
Senior Software Engineer, ML Infrastructure
…conversational experiences at scale. You will own production systems across ranking, model delivery, evaluation and LLM-agent behaviour, working closely with machine-learning, product, data and platform partners. This is a hands … quality gates through deployment and online validation. Build and operate an offline-evaluation platform, combining LLM-as-judge harnesses with deterministic checks for answer quality. Develop the Roku Entertainment Assistant's LLM…
Senior DevOps / Platform Engineer, AI Infrastructure
…Betriebsmodelle anhand von Latenz, Durchsatz, Kosten und Zuverlässigkeit. Perspektivisch erschließt du bei Bedarf eigenes LLM-Serving auf GPU-Infrastruktur. Europäische, souveräne Betriebsoptionen sind dabei ein Teil unserer zukünftigen Strategie. Du verbesserst … Sicherheitsupdates. Du verstehst die Grundlagen von RAG-Systemen und typische Fehlerquellen im Betrieb. Bei LLM-Serving kannst du Zielkonflikte zwischen Latenz, Durchsatz, Kosten und Betriebsaufwand einordnen. Du verfolgst die Entwicklung…
Forward Deployed Engineer, DACH
…load balancing, retries and fallbacks, rate limits, and per-team virtual keys • Instrument and govern LLM usage through the gateway — cost tracking and budgets, caching, logging and observability (OpenTelemetry, Langfuse, or similar … Germany, or eligible for sponsorship Bonus Points For • Experience with AI voice assistants, STT/TTS, or LLM-based conversational systems • Building eval sets for a specific domain • Hands-on production experience with…
Forward Deployed Engineer, DACH
…load balancing, retries and fallbacks, rate limits, and per-team virtual keys • Instrument and govern LLM usage through the gateway — cost tracking and budgets, caching, logging and observability (OpenTelemetry, Langfuse, or similar … Germany, or eligible for sponsorship Bonus Points For • Experience with AI voice assistants, STT/TTS, or LLM-based conversational systems • Building eval sets for a specific domain • Hands-on production experience with…
Senior Platform Engineer
…cost-efficient, and you extend it as the product grows. Most recently that meant an LLM gateway with region failover in front of our Azure OpenAI deployments, and performing GPU capacity planning … Design and deliver the platform capabilities the product needs next, from GPU capacity and an LLM gateway to new environments Set the standard for how we run Kubernetes and our managed data…
Senior Platform Engineer
…cost-efficient, and you extend it as the product grows. Most recently that meant an LLM gateway with region failover in front of our Azure OpenAI deployments, and performing GPU capacity planning … Design and deliver the platform capabilities the product needs next, from GPU capacity and an LLM gateway to new environments Set the standard for how we run Kubernetes and our managed data…
Senior Platform Engineer
…cost-efficient, and you extend it as the product grows. Most recently that meant an LLM gateway with region failover in front of our Azure OpenAI deployments, and performing GPU capacity planning … Design and deliver the platform capabilities the product needs next, from GPU capacity and an LLM gateway to new environments Set the standard for how we run Kubernetes and our managed data…
Senior DevOps Engineer — Agentic Platform
…deployments with promotion, rollback and environment-specific policy controls. Integrate automated unit, API, security and LLM-evaluation checks into release gates. Implement secrets handling, sandbox isolation and least-privilege deployment identities. Instrument … results enforceable in CI. Preferred Experience Release strategies such as canary, blue/green and progressive delivery. LLM or agent evaluation frameworks and benchmark execution in CI. Software supply-chain controls, artifact signing…
Senior AI Platform Engineer
…unstructured enterprise data into reusable AI capabilities. Develop production-ready AI applications using modern LLM frameworks and orchestration tools. Design reusable platform components for prompt management, model serving, vector search, embeddings … Retrieval-Augmented Generation (RAG) solutions, making use of embeddings, vector databases, and modern LLM orchestration frameworks. Have experience building or contributing to agentic AI systems , intelligent workflows, or orchestration frameworks. Backend & Platform…
Forward Deployed Engineer, France
…load balancing, retries and fallbacks, rate limits, and per-team virtual keys • Instrument and govern LLM usage through the gateway — cost tracking and budgets, caching, logging and observability (OpenTelemetry, Langfuse, or similar … authorized to work in France Bonus Points For • Experience with AI voice assistants, STT/TTS, or LLM-based conversational systems • Building eval sets for a specific domain • Hands-on production experience with…
Python Engineer
…Services, application deployment, GitHub Actions/CI/CD, JavaScript, and CSS. Experience with Generative AI, AI agents, and LLM tool/function calling is highly desirable. The engineer will work closely with client technical and product teams … Preferred / Nice-to-Have Skills Experience developing Generative AI applications or AI agents. Experience implementing LLM tool/function calling and connecting LLMs to APIs, databases, and enterprise systems. Knowledge of MCP (Model Context…
DevOps Engineer – AWS / Cloud
…mantenere e migliorare la piattaforma. Il progetto comprende anche tecnologie legate all' AI e agli LLM : non è necessario essere esperti di AI, ma è importante avere curiosità e voglia di imparare … scripting Monitoring e gestione dell'affidabilità della piattaforma Supporto all'integrazione di servizi AI e LLM Collaborazione con gli altri team tecnici CHI CERCHIAMO Cerchiamo una persona con almeno 3 anni…
DevOps / SRE | PropTech SaaS | Toulouse | CDI | 50 / 60k fixe
…scalabilité et l’intégration des workloads IA, notamment le compute et l'hébergement de LLM. Renforcer la sécurité des infrastructures cloud dans une démarche SecOps. Piloter l’optimisation continue des coûts … première expérience dans le hosting de modèles IA, le compute et l'intégration de LLM (outils type Cloud Code). Expérience sur des systèmes à forte volumétrie (plusieurs milliers d'utilisateurs actifs). Connaissance…
Senior DevOps / Platform Engineer, AI Infrastructure
…evaluate them based on reliability, latency, throughput, cost, and operational effort. You explore self-hosted LLM inference where it creates real value. Over time, this may include GPU infrastructure and serving technologies … where they commonly fail in production. You can discuss the basic trade-offs involved in LLM serving, including latency, throughput, reliability, cost, and operational complexity. You follow developments in models, inference providers…
Forward Deployed Engineer, France/Nordics
…load balancing, retries and fallbacks, rate limits, and per-team virtual keys • Instrument and govern LLM usage through the gateway — cost tracking and budgets, caching, logging and observability (OpenTelemetry, Langfuse, or similar … France, or eligible for sponsorship Bonus Points For • Experience with AI voice assistants, STT/TTS, or LLM-based conversational systems • Building eval sets for a specific domain • Hands-on production experience with…
Forward Deployed Engineer, France/Nordics
…load balancing, retries and fallbacks, rate limits, and per-team virtual keys • Instrument and govern LLM usage through the gateway — cost tracking and budgets, caching, logging and observability (OpenTelemetry, Langfuse, or similar … France, or eligible for sponsorship Bonus Points For • Experience with AI voice assistants, STT/TTS, or LLM-based conversational systems • Building eval sets for a specific domain • Hands-on production experience with…