Backend Engineer (+ Equity) at LlamaIndex

This is a job that Jill, our AI Recruiter, is recruiting for on behalf of one of our customers. She will pick the best candidates from Jack's network. The next step is to speak to Jack. Job Title Backend Engineer Salary Not Disclosed + Equity Company Description LlamaIndex is a Series A startup building the essential document infrastructure layer for the next generation of AI applications, supporting over 25 million monthly downloads on its open-source library. Job Description Join a high-caliber team at LlamaIndex building core services like LlamaCloud and LlamaParse. You will own the backend lifecycle for tools powering AI agentic workflows at scale. This role focuses on designing robust APIs and scaling Kubernetes-based infrastructure to handle millions of documents for a massive global developer community. Location San Francisco, USA Why this role is remarkable Scale massive impact with over 25 million monthly downloads on the open-source library, reaching the heart of the global AI developer ecosystem. Join a small, high-autonomy Series A team where you shape architectural decisions for critical AI infrastructure rather than just executing pre-defined tickets. Work at the cutting edge of AI agentic workflows, building the document processing layer that powers the world's most advanced LLM applications. What You Will Do Design, develop, and maintain high-performance Python-based APIs (REST, GraphQL, or gRPC) that serve as the foundation for LlamaCloud and LlamaParse. Architect and manage Kubernetes-based deployments across AWS/GCP, ensuring the scalability and reliability of systems processing millions of documents. Collaborate with a lean engineering team to ship end-to-end features, from service architecture to CI/CD automation via GitHub Actions. The ideal candidate Has 4+ years of production experience in Python, demonstrating engineering rigor from top-tier tech firms combined with the velocity of early-stage startups. Possesses deep expertise in Kubernetes, including deploying, scaling, and debugging complex containerized environments in production settings. Demonstrates a proven track record of shipping independently and thriving in fast-paced environments without the need for heavy management process or overhead. Who are Jack & Jill? Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support. And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate. How does this work? Jack's an AI agent for job searching and career coaching. He works for you. Jill is the AI recruiter working for the company. She recruits from Jack's network. If it's a match and the company wants to meet you, they'll make the intro. In the meantime, if you'd like, Jack will send you excellent alternatives. We never post fake jobs This isn't a trick. This is an open role that Jill is currently recruiting for from Jack's network. Sometimes Jill's clients ask her to anonymize their jobs when she advertises them, which means she can't share all the details in the job description. We appreciate this can make them look a bit suspect, but there isn't much we can do about it. Give Jack a spin! You could land this role. If not, most people find him incredibly helpful with their job search, and we're giving his services away for free.