Open Source Engineer, Agents

Reposted 3 Days Ago
2 Locations
In-Office or Remote
100K-210K Annually
Mid level
Artificial Intelligence • Information Technology • Machine Learning • Software
The Role
The Open Source Engineer will design powerful AI frameworks, maintain open-source repos, and develop interfaces for LLM applications, collaborating globally.
Summary Generated by Built In

Join us and help shape the future of AI by redefining document workflows with AI agents.

About The Role

We're seeking an Agent Engineer to join LlamaIndex, where you'll contribute to cutting-edge AI frameworks that empower developers worldwide to create Document Agents and RAG applications. Your work will directly impact thousands of developers and shape how the industry builds with LLMs and knowledge bases.

The Role

As an Agent Engineer at LlamaIndex, you'll wear two hats:

Open Source Innovation (60-70%)

Design and build core agent capabilities, retrieval algorithms, and document processing features that thousands of developers rely on daily. You'll push the boundaries of what's possible with LLM agents while maintaining the elegant, intuitive APIs LlamaIndex is known for.

Product Bridge (30-40%)

Work closely with our platform teams to translate open-source innovations into production-ready APIs and services via LlamaCloud. You'll ensure seamless developer experiences across both worlds, bringing learnings from open-source experimentation to productized features.

Key Responsibilities

Building Core Agent Tech

  • Develop and iterate rapidly on agentic reasoning systems, memory architectures, and retrieval pipelines that handle real-world document complexity

  • Ability to reason about LLM behavior, retrieval quality, and system design from first principles. This means building focused, high-quality tools rather than general-purpose wrappers.

  • Building with the community. This means helping to manage community interactions and feedback over Github and Discord.

Bridging Open Source & Product

  • Shape the evolution of LlamaCloud SDKs by bringing learnings from open-source experimentation to production APIs

  • Collaborate with platform teams to ensure feature parity and smooth migration paths between OSS and managed services

  • Translate community feedback and use cases into actionable product requirements

Technical Requirements
  • 3+ years of software engineering experience with production Python systems

  • Expert-level Python: modern tooling (uv, ruff, mypy), Pydantic, FastAPI/Flask

  • Hands-on experience building LLM-powered applications (production or personal projects), using both existing AI frameworks and from-scratch

  • Solid understanding of RAG patterns, embeddings, vector databases, and semantic search. All with existing AI frameworks and from-scratch

  • Active open-source contributor with strong technical writing skills

  • First-principles thinking: you build precise, well-scoped tools and understand why abstractions exist, not just how to use them

Preferred Qualifications
  • Deep knowledge of LLM architectures and internals (transformers, attention mechanisms, training/fine-tuning)

  • Built production agent systems with multi-step reasoning, tool use, or planning

  • Meaningful contributions to popular AI/ML open-source projects

  • Experience with Docker/Kubernetes, distributed systems, or API design

  • Active in AI research community (papers, blog posts, talks)

Location

Hybrid in San Francisco, CA preferred. Remote available.

What We Offer
  • Be a member of an innovative AI infrastructure team

  • Work on challenging, meaningful technical problems

  • Significant creative and technical autonomy

  • Opportunity to shape an open-source project with global impact

Why Join Us?
  • Impactful Mission: Work on innovative AI products that redefine how knowledge is accessed and utilized.

  • Collaborative Team: Join a team of passionate individuals committed to pushing the boundaries of technology.

  • Growth Opportunities: Be at the forefront of the AI revolution, with ample opportunities to grow alongside our scaling organization.

Additional Benefits
  • Competitive base salary and equity compensation

  • Comprehensive medical/dental/vision coverage for you and your family

  • Unlimited paid time off policy

  • Daily catered lunch and snacks in the San Francisco office

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

LlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.

Top Skills

Docker
Fastapi
Flask
Gradio
Kubernetes
Poetry
Python
Reflex
Streamlit
Typescript
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
44 Employees

What We Do

The data framework for LLMs

Python:
Github: https://github.com/jerryjliu/llama_index
Docs: https://docs.llamaindex.ai/

Typescript/Javascript:
Github: https://github.com/run-llama/LlamaIndexTS
Docs: https://ts.llamaindex.ai/

Other:
Discord: discord.gg/dGcwcsnxhU
LlamaHub: llamahub.ai
Twitter: https://twitter.com/llama_index
Blog: blog.llamaindex.ai

#ai #llms #rag

Similar Jobs

Pfizer Logo Pfizer

US I&I GI Sales Team Organizational Coordinator

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
8 Locations
32-54

Pfizer Logo Pfizer

Neuroscience Health and Science Professional - Keller, TX

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
Texas, USA
72K-180K Annually

Pfizer Logo Pfizer

Neuroscience Health and Science Professional (HSP), Boerne, TX

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
Texas, USA
73K-189K Annually

DraftKings Logo DraftKings

Senior Community Associate

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Remote or Hybrid
United States
67K-84K

Similar Companies Hiring

Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account