Senior Principal Machine Learning Engineer

Posted 2 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Healthtech • Biotech • Pharmaceutical
The Role
Design and build production systems for agentic AI applications, including backend APIs, session management, streaming, authentication, RAG, and agent architectures. Own MLOps, GitOps, CI/CD, deployment, observability, platform reliability, and engineering governance across teams. Lead complex incident resolution, evaluate GenAI tools and frameworks, make architecture decisions, and mentor engineers. The role requires deep Python, cloud, containerization, Kubernetes, CI/CD, LLM, and enterprise data platform expertise.
Summary Generated by Built In

At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us. 


Role Overview

We are looking for a Senior Principal Machine Learning Engineer to join the AI Engineering team, with a primary focus on Hands-On Engineering (MLE) and MLOps & Platform Reliability and GenAI & Agentic Systems. This posting is at level R4 on our engineering ladder — see the level framing below for the expected scope of ownership and impact.

Level framing: Recognized expert who mentors others; makes key technical decisions impacting multiple teams; leads resolution of highly complex challenges; cross-functional influence; may engage with external partners as an authority.

Core Responsibilities
  • Design and build production backend systems for agentic AI applications — API layers, backend-for-frontend (BFF) patterns, session/state management, and streaming for concurrent multi-user workloads.
  • Lead resolution of highly complex, cross-system technical challenges.
  • Set the technical bar for hands-on engineering practice across the team.
  • Own GitOps and engineering-governance standards across the team (version control, CI/CD, review, promotion).
  • Make key MLOps/platform decisions that affect multiple teams (e.g. deployment topology, observability strategy).
  • Drive triage and resolution of complex, cross-system production incidents.
  • Own architecture for agentic AI systems, including routing, policy enforcement, and RAG/knowledge-registry design.
  • Lead evaluation and adoption of new agent frameworks, LLMOps practices, and GenAI tooling across the team.
  • Implement authentication/authorization flows for agentic systems (OAuth/OIDC, on-behalf-of token exchange, secure credential storage).
  • Mentor other engineers on architecture, design patterns, and production engineering practices, and act as a role model for engineering rigor across the wider team.
Key Tools & Technologies
  • Cloud & Data Infra: AWS (EC2/ECS, S3, Lambda, IAM, CloudWatch or equivalent); Databricks & Unity Catalog
  • Foundational: Python; Git/GitHub; software engineering best practices; testing; SQL
  • MLOps & Deployment: Docker, Kubernetes, Prefect; CI/CD (GitHub Actions); production monitoring; model versioning & lineage; GitOps governance
  • GenAI & Agentic Architecture: Claude or comparable LLMs; LangGraph or comparable agent frameworks; RAG architectures; vector databases (e.g. Pinecone); prompt engineering & evaluation
Required Qualifications

11–15 years of hands-on experience, with demonstrated growth into architecture-level ownership spanning multiple teams or systems.

  • Strong proficiency in Python and a track record of writing clean, testable, production-quality code.
  • Demonstrated experience owning CI/CD, containerisation, and orchestration for production ML/AI systems.
  • Proven experience developing or deploying LLM-based applications, including prompt engineering, RAG, or agentic workflows.
  • Strong working knowledge of containerisation (Docker), orchestration (Kubernetes), and CI/CD pipelines.
  • Working knowledge of AWS cloud services and Databricks/Unity Catalog or equivalent enterprise data platforms.
  • Excellent verbal and written communication skills.
  • Experience working in Agile/Scrum environments.
Education

Bachelor's or Master's degree in Computer Science, Computer Applications, or a related technical field.

Lilly is dedicated to helping individuals with disabilities to actively engage in the workforce, ensuring equal opportunities when vying for positions. If you require accommodation to submit a resume for a position at Lilly, please complete the accommodation request form (https://careers.lilly.com/us/en/workplace-accommodation) for further assistance. Please note this is for individuals to request an accommodation as part of the application process and any other correspondence will not receive a response.

Lilly does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability or any other legally protected status.

#WeAreLilly

Skills Required

  • 11-15 years of hands-on experience with architecture-level ownership across multiple teams or systems
  • Bachelor's or Master's degree in Computer Science, Computer Applications, or a related technical field
  • Strong proficiency in Python and experience writing clean, testable, production-quality code
  • Experience owning CI/CD, containerization, and orchestration for production ML/AI systems
  • Experience developing or deploying LLM-based applications, including prompt engineering, RAG, or agentic workflows
  • Strong working knowledge of Docker, Kubernetes, and CI/CD pipelines
  • Working knowledge of AWS cloud services and Databricks/Unity Catalog or equivalent enterprise data platforms
  • Excellent verbal and written communication skills
  • Experience working in Agile/Scrum environments

Eli Lilly and Company Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Eli Lilly and Company and has not been reviewed or approved by Eli Lilly and Company.

  • Retirement Support Feedback suggests long-term savings are bolstered by a defined-benefit pension alongside a company 401(k) match and retiree health options. These elements make total compensation feel strong beyond base salary.
  • Leave & Time Off Breadth Feedback suggests paid time off is expansive, with substantial vacation, company shutdown days, and milestone time. This breadth of leave is viewed as a meaningful part of overall rewards.
  • Parental & Family Support Feedback suggests family-building and caregiving support are robust, including paid parental leave, adoption or surrogacy assistance, and backup care. These programs enhance the perceived value of benefits across life stages.

Eli Lilly and Company Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Indianapolis, IN
39,451 Employees
Year Founded: 1876

What We Do

Eli Lilly and Company engages in the discovery, development, manufacture, and sale of products in pharmaceutical products business segment. For more than a century, we have stayed true to a core set of values – excellence, integrity, and respect for people – that guide us in all we do: discovering medicines that meet real needs, improving the understanding and management of disease, and giving back to communities through philanthropy and volunteerism.

Similar Jobs

Eli Lilly and Company Logo Eli Lilly and Company

Machine Learning Engineer

Healthtech • Biotech • Pharmaceutical
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
39451 Employees
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees

Capital One Logo Capital One

Lead Software Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
55000 Employees

Optum Logo Optum

Machine Learning Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
160000 Employees

Similar Companies Hiring

Sailor Health Thumbnail
Healthtech • Social Impact • Telehealth
New York City, NY
20 Employees
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account