Agentic AI Engineer

Posted 5 Days Ago
Hiring Remotely in United States
Remote
Senior level
Information Technology • Database • Consulting
The Role
Lead design and build scalable autonomous and semi‑autonomous multi‑agent AI systems. Implement RAG pipelines, tool‑calling agents, memory, observability, and AgentOps. Ensure production readiness, safety, governance, and secure data handling. Provide technical leadership, mentor engineers, and shape platform standards across teams.
Summary Generated by Built In

We are seeking a Lead Agentic AI Engineer with a strong software engineering foundation to design, build, and scale autonomous and semi‑autonomous AI systems. This role goes beyond prompt engineering or isolated models—you will architect multi‑agent systems that plan, reason, call tools, interact with enterprise systems, and operate safely at scale.

You will work on agent orchestration, RAG pipelines, tool‑calling, memory, observability, and AgentOps, while ensuring production readiness, compliance, and reliability.

Responsibilities

Agentic AI System Design

  • Design and implement multi‑agent architectures including:
    • Orchestrator / supervisor agents
    • Task‑specialized agents (research, extraction, validation, decisioning)
    • Reflection, critique, and self‑correction loops
  • Build goal‑driven agent workflows with constrained autonomy and human‑in‑the‑loop patterns.
  • Define agent boundaries, decision policies, and escalation logic.

LLM, RAG & Tooling

  • Build enterprise‑grade RAG systems:
    • Ingestion, chunking, metadata enrichment
    • Vector indexing and retrieval strategies
    • Grounded generation and citation control
  • Implement tool‑calling agents that interact with:
    • APIs, databases, search systems
    • Internal platforms and workflows
  • Optimize latency, cost, and accuracy across LLM interactions.

Production Engineering & AgentOps

  • Build agentic systems as scalable backend services (FastAPI / REST / async services).
  • Apply strong software engineering discipline:
    • Modular code, clean abstractions, testability
    • CI/CD, versioning of prompts, tools, and agents
  • Implement AgentOps / LLMOps, including:
    • Evaluation harnesses (prompt, retrieval, agent behavior)
    • Observability (traces, metrics, decision paths)
    • Rollback and controlled rollout strategies
  • Ensure robustness against hallucinations, loops, tool failures, and unsafe actions.

Governance, Safety & Reliability

  • Implement guardrails, policies, and monitoring for agent behavior.
  • Design systems with traceability, auditability, and explainability.
  • Ensure secure handling of sensitive data (PII/PHI where applicable).
  • Enforce responsible‑AI principles in autonomous systems.

Technical Leadership

  • Lead design reviews and mentor junior engineers.
  • Influence platform standards for agentic AI across teams.
  • Partner with product managers, architects, and domain SMEs to translate workflows into agent behavior.
Qualifications

Strong Software Engineering Background (Must Have)

  • 8–10 years of experience with backend/software engineering
  • Expert in Python (primary) and API‑based services
  • Experience with distributed systems, microservices, async processing
  • Strong understanding of system design, scalability, and performance

Agentic AI & GenAI Expertise

  • Proven experience building agentic AI systems (not just chatbots)
  • Hands‑on with agent frameworks (e.g., LangChain / LangGraph / equivalent)
  • Strong understanding of:
    • Tool‑calling, planning, reflection
    • Memory, state, and long‑running agents
  • Experience working with LLMs (cloud and/or open‑source)

RAG & Data Engineering

  • Production experience with vector databases
  • Knowledge of embeddings, retrieval strategies, reranking
  • Comfortable with structured + unstructured enterprise data

Platform & Ops

  • Docker, CI/CD, cloud deployments (AWS / Azure / GCP)
  • Experience with monitoring, logging, and production debugging
  • Familiarity with MLflow or similar experiment tracking tools

Nice to Have

  • Experience in healthcare, insurance, or regulated domains
  • Exposure to AI governance, compliance, or risk frameworks
  • Built internal AI platforms or reusable accelerators
  • Prior experience tech‑leading enterprise AI initiatives

Skills Required

  • 8-10 years of backend/software engineering experience
  • Expert in Python and API-based services
  • Experience with distributed systems, microservices, and async processing
  • Strong system design, scalability, and performance understanding
  • Proven experience building agentic AI systems (multi-agent architectures)
  • Hands-on experience with agent frameworks (e.g., LangChain, LangGraph, or equivalent)
  • Knowledge of tool-calling, planning, reflection, and long-running agent patterns
  • Experience working with LLMs (cloud and/or open-source)
  • Production experience with vector databases
  • Knowledge of embeddings, retrieval strategies, and reranking
  • Comfortable handling structured and unstructured enterprise data
  • Experience with Docker, CI/CD, and cloud deployments (AWS/Azure/GCP)
  • Experience with monitoring, logging, and production debugging
  • Familiarity with MLflow or similar experiment tracking tools
  • Experience in healthcare, insurance, or regulated domains
  • Exposure to AI governance, compliance, or risk frameworks
  • Built internal AI platforms or reusable accelerators
  • Prior experience tech-leading enterprise AI initiatives
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
30,246 Employees
Year Founded: 1999

What We Do

Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.

Similar Jobs

ServiceNow Logo ServiceNow

Artificial Intelligence Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
29000 Employees
176K-308K Annually

ServiceNow Logo ServiceNow

Staff Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
29000 Employees
167K-291K Annually

Dynatrace Logo Dynatrace

Senior Software Engineer

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Remote or Hybrid
Boston, MA, USA
5600 Employees
61K-92K Annually

ServiceNow Logo ServiceNow

Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
29000 Employees
201K-352K Annually

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account