AI Architect

Posted 8 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Expert/Leader
Information Technology • Consulting
The Role
Leads the architecture, strategy, and implementation of enterprise AI/ML platforms, GenAI applications, governance systems, and agentic solutions. Designs cloud-native, secure, scalable architectures, MLOps pipelines, integrations, observability, and multi-tenant SaaS platforms. Provides technical leadership, conducts architecture reviews, mentors engineering teams, guides technology selection, and aligns AI architecture with business objectives and compliance requirements.
Summary Generated by Built In
AI Architect

Req number:

R8730

Employment type:

Full time

Worksite flexibility:

RemoteWho we are

CAI is a global services firm with over 9,000 associates worldwide and a yearly revenue of $1.3 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.

Job Summary

We are looking for a motivated AI Architect ready to take us to the next level! If you have lead the design, strategy, and implementation of cutting-edge AI/ML platforms and solutions and are looking for your next career move, apply now.

Job Description

We are looking for an AI Architect to lead the design, strategy, and implementation of cutting-edge AI/ML platforms and solutions. This position will be full-time and remote.

What You’ll Do

  • Define technical vision and architecture for conversational AI platforms, AI governance systems, and domain-specific agentic solutions
  • Design cloud-native, microservices-based architectures for GenAI applications using AWS/Azure, Kubernetes, and API management platforms
  • Establish architectural standards for LLM integration (Claude, OpenAI), RAG systems, vector databases, and AI orchestration
  • Drive technology selection for frontend (React/Angular), backend (FastAPI, Node.js), databases (PostgreSQL, MongoDB, OpenSearch), and AI frameworks (LangChain, LlamaIndex)
  • Design AI governance frameworks including usage tracking, cost optimization, access control (RBAC/ABAC), and compliance enforcement (SOC 2, GDPR)
  • Architect API security patterns (OAuth 2.0, JWT, mTLS), data encryption, and audit logging for AI platforms
  • Define multi-tenancy architecture for SaaS-based AI solutions with role-based access and data isolation
  • Provide technical leadership to engineering teams (backend, frontend, AI/ML, DevOps) across India CoE and Singapore
  • Conduct architecture reviews, design reviews, and guide implementation decisions for high-impact GenAI projects
  • Collaborate with product managers, business stakeholders, and executive leadership to align technical architecture with business objectives
  • Mentor architects and senior engineers on cloud-native design, AI/ML best practices, and enterprise integration patterns
  • Design MLOps pipelines for AI model deployment, versioning, monitoring, and A/B testing
  • Architect enterprise integrations with APIs, message brokers (Kafka, RabbitMQ), and legacy systems using event-driven patterns
  • Define observability and monitoring strategies using Prometheus, Grafana, Datadog, and CloudWatch

 What You'll Need

Required:

  • 15+ years in enterprise software architecture with 5+ years designing AI/ML platforms or GenAI solutions
  • Deep expertise in cloud-native architectures (AWS/Azure), microservices, API design, and distributed systems
  • Strong knowledge of GenAI technologies (LLMs, RAG systems, vector databases, prompt engineering, agentic frameworks)
  • Proven experience architecting enterprise-scale platforms serving 10,000+ users with high availability and security requirements
  • Expert-level knowledge of backend frameworks (FastAPI, Node.js, Django), frontend frameworks (React, Angular), and database systems (SQL, NoSQL, vector databases)
  • Strong understanding of AI/ML frameworks (LangChain, LlamaIndex, Hugging Face), model serving (TensorFlow Serving, Triton), and MLOps practices
  • Proficiency in API management (MuleSoft, Apigee, Kong), event-driven architectures, and message brokers (Kafka, RabbitMQ)
  • Deep knowledge of security (OAuth 2.0, JWT, encryption, OWASP), compliance (SOC 2, GDPR), and data privacy
  • Proven ability to lead cross-functional teams, influence technical decisions, and drive architectural alignment
  • Excellent communication skills with ability to present complex architectures to executive leadership and non-technical stakeholders
  • Experience managing vendor relationships, technology partnerships, and third-party integrations
  • Strong decision-making abilities based on data-driven insights, trade-off analysis, and business impact

 Preferred:

  • Certifications: AWS Solutions Architect Professional, Azure Solutions Architect Expert, TOGAF, or equivalent
  • Experience with AI governance platforms, prompt management systems, and LLM observability tools (LangSmith, Weights & Biases)
  • Knowledge of service mesh (Istio, Linkerd), API federation, and zero-trust security architectures
  • Prior experience in manufacturing, engineering, or industrial domains is a plus

Physical Demands

  • Ability to safely and successfully perform the essential job functions
  • Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.
  • Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor

Reasonable accommodation statement

If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to [email protected] or (888) 824 – 8111.

Skills Required

  • 15+ years of experience in enterprise software architecture
  • 5+ years designing AI/ML platforms or GenAI solutions
  • Deep expertise in cloud-native architectures, AWS or Azure, microservices, API design, and distributed systems
  • Strong knowledge of GenAI technologies, including LLMs, RAG systems, vector databases, prompt engineering, and agentic frameworks
  • Experience architecting enterprise-scale platforms serving 10,000+ users with high availability and security requirements
  • Expert-level knowledge of FastAPI, Node.js, Django, React, Angular, SQL, NoSQL, and vector databases
  • Strong understanding of LangChain, LlamaIndex, Hugging Face, TensorFlow Serving, Triton, and MLOps practices
  • Proficiency in MuleSoft, Apigee, Kong, event-driven architectures, Kafka, and RabbitMQ
  • Deep knowledge of OAuth 2.0, JWT, encryption, OWASP, SOC 2, GDPR, and data privacy
  • Ability to lead cross-functional teams, influence technical decisions, and drive architectural alignment
  • Excellent communication skills and ability to present complex architectures to executives and nontechnical stakeholders
  • Experience managing vendor relationships, technology partnerships, and third-party integrations
  • Strong data-driven decision-making, trade-off analysis, and business-impact assessment skills
  • AWS Solutions Architect Professional, Azure Solutions Architect Expert, TOGAF, or equivalent certification
  • Experience with AI governance platforms, prompt management systems, and LLM observability tools such as LangSmith or Weights & Biases
  • Knowledge of Istio, Linkerd, API federation, and zero-trust security architectures
  • Prior manufacturing, engineering, or industrial domain experience

CAI (cai.io). Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about CAI (cai.io). and has not been reviewed or approved by CAI (cai.io)..

  • Retirement Support — Retirement contributions and an ownership component are highlighted as standout perks and positioned as a key strength of the package. This is framed as a notable differentiator within the overall offering.
  • Wellbeing & Lifestyle Benefits — A wellness program that can reduce medical premiums, an Employee Assistance Program, and active employee resource groups are emphasized. A work-from-anywhere philosophy and flexible scheduling are also presented as quality-of-life benefits when client needs allow.
  • Affordable Benefits — The primary medical setup is described as a high-deductible option with low premiums and an HSA contribution, which some view as cost-effective. Wellness participation is stated to further lower monthly premiums.

CAI (cai.io). Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Indianapolis, IN
2,689 Employees

What We Do

CAI is a global services firm with over 8,700 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what’s right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise

Similar Jobs

Coursera + Udemy  Logo Coursera + Udemy

Architect

Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Remote or Hybrid
India
1500 Employees

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Solutions Architect

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
85422 Employees
In-Office or Remote
Bangalore, Bengaluru, Karnataka, IND
729 Employees

Accenture Logo Accenture

Architect

Information Technology
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
456553 Employees

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account