Senior AI Architect

Posted Yesterday
Be an Early Applicant
Hiring Remotely in India
Remote or Hybrid
Senior level
Information Technology • Database • Consulting
The Role
Design, build, and productionize multi-agent and conversational AI systems. Own architecture, model selection, RAG pipelines, evaluation/guardrails, and LLMOps. Lead technical standards, mentor teams, and translate agentic AI research into scalable, secure enterprise solutions across regulated domains.
Summary Generated by Built In

About the Role

EXL is looking for an Applied Agentic AI Architect to design, build, and productionize autonomous and semi-autonomous AI agent systems that power real business outcomes for our clients. This is a hands-on architecture role: you will own the technical design of multi-agent and conversational AI solutions end to end — from orchestration patterns and model selection to evaluation, guardrails, and deployment at scale.

You will sit at the intersection of applied research and engineering, translating fast-moving agentic AI capabilities into robust, secure, and cost-effective solutions across domains such as insurance, healthcare, banking, and customer operations. You will work directly with client stakeholders, data scientists, and engineering teams to move solutions from proof-of-concept to enterprise production.

Key Responsibilities

  • Architect agentic systems. Design multi-agent architectures — planner/executor patterns, tool-calling, memory, retrieval, and human-in-the-loop workflows — that are reliable, observable, and maintainable in production.
  • Build with modern agent frameworks. Implement solutions using frameworks such as LangGraph and Google's Agent Development Kit (ADK), selecting the right orchestration pattern for each use case.
  • Design conversational AI. Architect enterprise conversational and voice AI experiences — including contact-center and customer-experience solutions on platforms such as GECX — covering intent handling, dialog management, escalation, and containment.
  • Model strategy & selection. Evaluate and integrate frontier LLMs including Gemini, Grok, and others; make principled trade-offs across accuracy, latency, context window, cost, and deployment constraints.
  • Retrieval & grounding. Design RAG pipelines, knowledge integration, and grounding strategies to reduce hallucination and improve factual reliability.
  • Evaluation & guardrails. Establish evaluation harnesses, offline/online metrics, red-teaming, safety guardrails, and monitoring for agent behavior in production.
  • Productionize & scale. Own MLOps/LLMOps concerns — CI/CD for prompts and agents, versioning, observability, caching, and cost optimization.
  • Lead technically. Set architecture standards and reusable patterns, review designs, mentor engineers and data scientists, and act as a trusted technical advisor to clients.
  • Stay ahead. Track the rapidly evolving agentic AI landscape and translate new techniques into practical, differentiated client offerings.

Required Qualifications

  • Bachelor's or Master's in Computer Science, AI/ML, Engineering, or equivalent practical experience.
  • 8+ years in software/AI engineering, with 3+ years building and shipping production ML/GenAI systems (architecture-level experience strongly preferred).
  • Hands-on experience designing and deploying agentic AI systems — multi-agent orchestration, tool use, memory, and planning.
  • Practical experience with agent frameworks such as LangGraph and ADK (Agent Development Kit).
  • Demonstrated experience building Conversational AI / voice AI solutions, ideally including CX/contact-center platforms such as GECX.
  • Working experience with frontier LLMs such as Gemini, Grok, and comparable models, including prompt engineering and evaluation.
  • Strong programming skills in Python and solid software engineering fundamentals (APIs, testing, version control, system design).
  • Experience with RAG, vector stores, and embedding-based retrieval.
  • Familiarity with at least one major cloud (GCP, Azure, or AWS) and modern MLOps/LLMOps practices.

Preferred Qualifications

  • Experience deploying agentic solutions in regulated industries (insurance, healthcare, banking, financial services).
  • Knowledge of AI safety, responsible AI, security, and data privacy in enterprise settings.
  • Experience with observability/eval tooling for LLM applications and agent tracing.
  • Exposure to additional frameworks and tooling (e.g., LangChain, LlamaIndex, Semantic Kernel, MCP-based tool integration).
  • Prior client-facing or consulting experience, with strong communication and stakeholder-management skills.
  • Contributions to open-source AI projects, publications, or a track record of applied AI innovation.

What Success Looks Like

  • Agentic and conversational AI solutions move reliably from concept to production, with measurable business impact.
  • Reusable architecture patterns, evaluation frameworks, and guardrails become standard across engagements.
  • Clients trust you as the go-to authority on applied agentic AI.

What We Offer

  • The opportunity to build cutting-edge agentic AI systems that reach millions of users.
  • A collaborative, research-informed engineering culture.
  • Competitive compensation, benefits, and growth opportunities.
Responsibilities

About the Role

EXL is looking for an Applied Agentic AI Architect to design, build, and productionize autonomous and semi-autonomous AI agent systems that power real business outcomes for our clients. This is a hands-on architecture role: you will own the technical design of multi-agent and conversational AI solutions end to end — from orchestration patterns and model selection to evaluation, guardrails, and deployment at scale.

You will sit at the intersection of applied research and engineering, translating fast-moving agentic AI capabilities into robust, secure, and cost-effective solutions across domains such as insurance, healthcare, banking, and customer operations. You will work directly with client stakeholders, data scientists, and engineering teams to move solutions from proof-of-concept to enterprise production.

Key Responsibilities

  • Architect agentic systems. Design multi-agent architectures — planner/executor patterns, tool-calling, memory, retrieval, and human-in-the-loop workflows — that are reliable, observable, and maintainable in production.
  • Build with modern agent frameworks. Implement solutions using frameworks such as LangGraph and Google's Agent Development Kit (ADK), selecting the right orchestration pattern for each use case.
  • Design conversational AI. Architect enterprise conversational and voice AI experiences — including contact-center and customer-experience solutions on platforms such as GECX — covering intent handling, dialog management, escalation, and containment.
  • Model strategy & selection. Evaluate and integrate frontier LLMs including Gemini, Grok, and others; make principled trade-offs across accuracy, latency, context window, cost, and deployment constraints.
  • Retrieval & grounding. Design RAG pipelines, knowledge integration, and grounding strategies to reduce hallucination and improve factual reliability.
  • Evaluation & guardrails. Establish evaluation harnesses, offline/online metrics, red-teaming, safety guardrails, and monitoring for agent behavior in production.
  • Productionize & scale. Own MLOps/LLMOps concerns — CI/CD for prompts and agents, versioning, observability, caching, and cost optimization.
  • Lead technically. Set architecture standards and reusable patterns, review designs, mentor engineers and data scientists, and act as a trusted technical advisor to clients.
  • Stay ahead. Track the rapidly evolving agentic AI landscape and translate new techniques into practical, differentiated client offerings.

Required Qualifications

  • Bachelor's or Master's in Computer Science, AI/ML, Engineering, or equivalent practical experience.
  • 8+ years in software/AI engineering, with 3+ years building and shipping production ML/GenAI systems (architecture-level experience strongly preferred).
  • Hands-on experience designing and deploying agentic AI systems — multi-agent orchestration, tool use, memory, and planning.
  • Practical experience with agent frameworks such as LangGraph and ADK (Agent Development Kit).
  • Demonstrated experience building Conversational AI / voice AI solutions, ideally including CX/contact-center platforms such as GECX.
  • Working experience with frontier LLMs such as Gemini, Grok, and comparable models, including prompt engineering and evaluation.
  • Strong programming skills in Python and solid software engineering fundamentals (APIs, testing, version control, system design).
  • Experience with RAG, vector stores, and embedding-based retrieval.
  • Familiarity with at least one major cloud (GCP, Azure, or AWS) and modern MLOps/LLMOps practices.

Preferred Qualifications

  • Experience deploying agentic solutions in regulated industries (insurance, healthcare, banking, financial services).
  • Knowledge of AI safety, responsible AI, security, and data privacy in enterprise settings.
  • Experience with observability/eval tooling for LLM applications and agent tracing.
  • Exposure to additional frameworks and tooling (e.g., LangChain, LlamaIndex, Semantic Kernel, MCP-based tool integration).
  • Prior client-facing or consulting experience, with strong communication and stakeholder-management skills.
  • Contributions to open-source AI projects, publications, or a track record of applied AI innovation.

What Success Looks Like

  • Agentic and conversational AI solutions move reliably from concept to production, with measurable business impact.
  • Reusable architecture patterns, evaluation frameworks, and guardrails become standard across engagements.
  • Clients trust you as the go-to authority on applied agentic AI.

What We Offer

  • The opportunity to build cutting-edge agentic AI systems that reach millions of users.
  • A collaborative, research-informed engineering culture.
  • Competitive compensation, benefits, and growth opportunities.
Qualifications

Bachelor's/Master's

Skills Required

  • Bachelor's or Master's in Computer Science, AI/ML, Engineering, or equivalent practical experience.
  • 8+ years in software/AI engineering, with 3+ years building and shipping production ML/GenAI systems.
  • Architecture-level experience with production ML/GenAI systems.
  • Hands-on experience designing and deploying agentic AI systems (multi-agent orchestration, tool use, memory, planning).
  • Practical experience with agent frameworks such as LangGraph and ADK (Agent Development Kit).
  • Experience building Conversational AI / voice AI solutions, ideally including CX/contact-center platforms such as GECX.
  • Working experience with frontier LLMs such as Gemini and Grok, including prompt engineering and evaluation.
  • Strong programming skills in Python and solid software engineering fundamentals (APIs, testing, version control, system design).
  • Experience with RAG, vector stores, and embedding-based retrieval.
  • Familiarity with at least one major cloud (GCP, Azure, or AWS) and modern MLOps/LLMOps practices.
  • Experience deploying agentic solutions in regulated industries (insurance, healthcare, banking, financial services).
  • Knowledge of AI safety, responsible AI, security, and data privacy in enterprise settings.
  • Experience with observability/eval tooling for LLM applications and agent tracing.
  • Exposure to additional frameworks and tooling (e.g., LangChain, LlamaIndex, Semantic Kernel, MCP-based tool integration).
  • Prior client-facing or consulting experience, with strong communication and stakeholder-management skills.
  • Contributions to open-source AI projects, publications, or a track record of applied AI innovation.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
30,246 Employees
Year Founded: 1999

What We Do

Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.

Similar Jobs

Perficient Logo Perficient

Architect

Information Technology
In-Office or Remote
2 Locations
3295 Employees

o9 Solutions Logo o9 Solutions

Architect

Digital Media • Software • Analytics
In-Office or Remote
50 Locations
920 Employees
204K-280K Annually

NextHire Consulting Logo NextHire Consulting

Architect

Artificial Intelligence • HR Tech • Professional Services • Software
Remote
India
100 Employees

Müller's Solutions Logo Müller's Solutions

Architect

Information Technology
In-Office or Remote
5 Locations
9 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account