AI Data Architect

Posted 3 Days Ago
Be an Early Applicant
5 Locations
In-Office
Expert/Leader
Cloud • Information Technology • Consulting
The Role
Design and lead enterprise AI data architecture for agentic workflows: ingest, prepare, and structure operational data (ServiceNow, CMDB, code repos), build governed RAG pipelines, vector/index strategies, semantic search, knowledge graphs, and enforce data governance, lineage, privacy, and access controls. Provide cross-functional architectural leadership and deliver blueprints, evaluation metrics, and production-ready data products across cloud platforms.
Summary Generated by Built In

Who We Are

At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses.  We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.


The Role

Your role:

The ideal candidate will define and lead the target-state AI data architecture across all lifecycle stages—from initial transition and Day 1 operations to ongoing BAU support and continuous optimization. In this role, you will architect mechanisms to ingest, prepare, and structure complex enterprise data sources (including ServiceNow, CMDB, knowledge bases, code repositories, monitoring feeds, and operational logs) for seamless AI agent consumption. You will design governed Retrieval-Augmented Generation (RAG) pipelines, semantic search models, vector indexing strategies, knowledge graphs, and scalable data products tailored for agentic workflows. Crucially, you will enforce strict data governance, ensuring all data accessed by AI agents remains highly accurate, permission-aware, traceable, auditable, and compliant with customer privacy and data boundary standards. Additionally, you will provide cross-functional architectural leadership to AI Data Engineers, Agent Engineers, Forward Deploy Engineers, Solution Architects, and customer stakeholders to align data strategy with operational objectives.
What you will do:

  • End-to-End Data Architecture: Design blueprints and canonical models for ingesting, enriching, and serving operational enterprise data (ServiceNow, CMDB, Git, SharePoint, SOPs) to AI agents.

  • Agentic Data Enablement: Architect governed APIs, retrieval services, context packages, and structured output schemas for multi-agent workflows and Agent Builder platforms.

  • RAG & Search Strategy: Define enterprise RAG models, chunking/indexing policies, hybrid search patterns, and vector database topologies (Azure AI Search, Pinecone, Milvus, pgvector).

  • Data Quality & Benchmarking: Establish quality thresholds, retrieval precision/recall metrics, and golden evaluation datasets to measure drift and optimize response accuracy.

  • Security & Access Governance: Enforce Zero Trust data access, RBAC/ABAC, data boundaries, privacy masking, and lineage logging across all AI retrieval and model interaction layers.

  • Cloud & Platform Blueprinting: Architect scalable data pipelines, storage, and lakehouse/vector infrastructure across Azure, GCP, AWS, Databricks, or Snowflake landing zones.

  • AMS Domain Modeling: Map ITSM and Application Management Services operational workflows (incidents, CMDB, SLAs) into high-value data products for automated ticket analysis and runbook generation.

  • Engineering Leadership: Provide architectural direction to Forward Deploy and Data Engineers while managing standards for performance, cost, security, and production readiness.

Your Future at Kyndryl
The career path ahead is full of exciting opportunities to grow and advance within the job family. With dedication and hard work, you can climb the ladder to higher bands, achieving coveted positions such as Principal Engineer or Vice President of Software. These roles not only offer the chance to inspire and innovate, but also bring with them a sense of pride and accomplishment for having reached the pinnacle of your career in the software industry.


Who You Are

You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others.

Required Technical and Professional Experience
  • AI & Agentic Data Architecture: 10+ years in enterprise data/platform architecture, with 3+ years specifically building GenAI, RAG, and AI agent data models using frameworks like LangChain, LlamaIndex, and AutoGen.

  • LLM, RAG & Vector Platforms: Expertise in context management, grounding, chunking, and hybrid search across vector engines (Azure AI Search, Pinecone, Milvus, pgvector) and major LLMs (Azure OpenAI, Gemini, Claude, Llama).

  • Enterprise Data & Storage: Deep experience in canonical and semantic data modeling, data products, lakehouses, and modern data platforms (Databricks, Snowflake, BigQuery, Fabric) across Azure, GCP, or AWS.

  • AMS & ITSM Domain Expertise: Proven track record with ServiceNow, CMDB models, ticket workflows, SLA analytics, and transforming operational IT assets into AI-ready data products.

  • Governance, Security & Lineage: Strong capability in designing Zero Trust data access (RBAC/ABAC), data mesh concepts, lineage tracking, privacy controls, and audit frameworks for enterprise compliance.

  • Evaluation & Lifecycle Quality: Skilled in establishing evaluation datasets, drift detection, retrieval performance metrics (precision/recall), and agent contract schemas to eliminate hallucinations.

  • Consulting & Stakeholder Leadership: Ability to facilitate workshops, drive data discovery under ambiguity, run architecture reviews, and align multi-disciplinary engineering and business teams.

  • Core Artifact Ownership: Responsible for delivering AI Data Blueprints, RAG/vector strategies, source-to-target mappings, governance frameworks, and data engineering implementation guidelines.

Preferred Technical and Professional Experience

  • Master Degree & any relevant certification


Being You

The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.

What You Can Expect

Your career with us isn’t just a job—it’s an adventure with purpose.  We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best.
From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here—and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.

Get Referred!

If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.

Skills Required

  • 10+ years in enterprise data/platform architecture
  • 3+ years building GenAI, RAG, and AI agent data models using LangChain, LlamaIndex, AutoGen
  • Experience with vector engines and hybrid search (Azure AI Search, Pinecone, Milvus, pgvector)
  • Familiarity with major LLMs and context/grounding strategies (Azure OpenAI, Gemini, Claude, Llama)
  • Deep experience in canonical and semantic data modeling, lakehouse and data product design (Databricks, Snowflake, BigQuery, Fabric)
  • Domain expertise in AMS/ITSM (ServiceNow, CMDB, ticket workflows, SLA analytics)
  • Designing governance, Zero Trust access, RBAC/ABAC, lineage tracking, privacy controls, and audit frameworks
  • Establishing evaluation datasets, drift detection, retrieval metrics (precision/recall) and agent contract schemas
  • Consulting and stakeholder leadership: run workshops, architecture reviews, and align multidisciplinary teams
  • Deliver AI Data Blueprints, RAG/vector strategies, source-to-target mappings, and implementation guidelines
  • Master's degree or relevant certification

Kyndryl Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Kyndryl and has not been reviewed or approved by Kyndryl.

  • Fair & Transparent Compensation Pay is considered good in some roles, with mentions of “good pay,” “great pay and benefits,” and an “acceptable salary range” paired with bonuses. Certain senior or consulting tracks are described as market-competitive.
  • Leave & Time Off Breadth Vacation, paid time off, holidays, and a dedicated volunteer day are highlighted as positives. Parental leave exists companywide alongside sick leave and disability coverage.
  • Wellbeing & Lifestyle Benefits Remote and hybrid flexibility is emphasized, including 100% remote roles and a formal flexible workplace policy. Well‑being resources such as the Be Well program and an EAP are available.

Kyndryl Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
46,070 Employees
Year Founded: 2021

What We Do

We have the world’s best talent that design, run, and manage the most advanced and reliable technology infrastructure each day. Together, we think holistically about the health of these vital technology ecosystems. We are a focused, independent company that builds on our foundation of excellence by creating systems in new ways. Bringing in the right partners, investing in our business, and working side-by-side with our customers to unlock potential. We're raising the bar. Our experience speaks for itself: We have 90,000 highly skilled employees around the world serving 75 of the Fortune 100. But our purpose is what drives us: Advancing the vital systems that power human progress. Because when a digital ecosystem is healthy, it can more readily adapt and support continuous growth and that opens up a world of possibility for everyone.

Similar Jobs

EXL Logo EXL

Principal Architect

Information Technology • Database • Consulting
Hybrid
Pune, Mahārāshtra, IND
30246 Employees

EXL Logo EXL

Architect

Information Technology • Database • Consulting
Hybrid
Pune, Mahārāshtra, IND
30246 Employees

Photon Logo Photon

Data Architect

Agency • Information Technology
In-Office or Remote
2 Locations
5017 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account