Direct the enterprise GenAI technology portfolio and lead large-scale, onshore client engagements.
Act as a trusted senior technical architect and advisor to client leadership, bridging the gap between cutting-edge AI capabilities and core business transformation.
Oversee multiple architectural delivery streams, making high-impact decisions on technology stacks, framework selection, and infrastructural trade-offs across the 7-layer AI stack.
Responsibilities- Enterprise AI Strategy & Trade-Off Analysis: Define multi-year GenAI roadmaps by evaluating structural architecture trade-offs across the 7-layer LLM stack. Compare Commercial APIs (e.g., GPT-4o, Claude 3.5 Sonnet) vs. Hosted Open-Source LLMs (e.g., Llama 3) based on cost, latency, and data privacy.
- Advanced Architecture Oversight: Review and approve macro-level AI architectures. Architect scalable data ingestion pipelines, selecting between standard semantic RAG, Agentic RAG, or GraphRAG depending on enterprise complexity.
- Advanced Observability & Monitoring: Design deeply integrated AI observability (OBS) layers tailored for LLMs. Implement specialized tools (e.g., LangSmith, Phoenix, Arize) to track token consumption, trace complex agentic reasoning loops, and monitor model drift and hallucination rates in production.
- Robust Data Protection Strategy: Architect comprehensive data protection pipelines utilizing Enterprise Data Loss Prevention (DLP) tools. Ensure data is sanitized before hitting external APIs and implement robust semantic caching to prevent sensitive data leakage.
- Executive Consulting & Technical Pitching: Lead onshore client-facing engagements, pitching complex AI solutions to C-suite stakeholders, translating engineering trade-offs into clear financial and operational ROI frameworks.
- Consulting Skills: High-impact executive presence; extensive experience in technology consulting, solution scoping, and technical proposal architecture.
- Senior Technical Architecture Mastery: Deep hands-on background in enterprise integration patterns. Expert-level capability in comparing orchestration layers (e.g., LangChain vs. LlamaIndex vs. Semantic Kernel) and evaluating modern execution environments (vLLM, TensorRT-LLM).
- Cloud & Vector Strategy: Deep familiarity with dictating enterprise data storage choices by comparing managed vector services (Pinecone) vs. distributed open-source engines (Milvus/Qdrant) or extending existing relational systems (pgvector).
- Qualifications: Master’s in computer science, AI, or IT Management; 12–18 years of progressive IT/AI experience, heavily indexing on senior technical architecture and client delivery.
The typical base pay range for this role across the U.S. is USD $200,000 - $280,000 per year.
For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits
The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale.
Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position.
The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.
Skills Required
- Executive presence and extensive technology consulting, solution scoping, and proposal architecture experience.
- Deep hands-on senior technical architecture and enterprise integration experience.
- Expertise comparing orchestration layers (LangChain, LlamaIndex, Semantic Kernel).
- Experience evaluating and recommending execution environments (vLLM, TensorRT-LLM).
- Familiarity with vector storage strategies and technologies (Pinecone, Milvus, Qdrant, pgvector).
- Design and implementation of RAG architectures (semantic RAG, Agentic RAG, GraphRAG).
- Implementing AI observability using tools such as LangSmith, Phoenix, Arize to monitor token usage, model drift, and hallucinations.
- Architecting data protection pipelines using Enterprise DLP, data sanitization before external APIs, and semantic caching to prevent leakage.
- Master's degree in Computer Science, AI, or IT Management.
- 12-18 years of progressive IT/AI experience with strong emphasis on senior technical architecture and client delivery.
What We Do
Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.
