AI Architect

Posted 23 Days Ago
Be an Early Applicant
2 Locations
In-Office
Mid level
Cloud • Information Technology • Consulting
The Role
Design and implement enterprise AI and Agentic AI architectures that are scalable, secure, reliable, governable, and maintainable. Translate business and technical requirements into architectures spanning AI agents, foundation models, data platforms, APIs, orchestration, observability, security, and cloud infrastructure. Integrate AI solutions with enterprise systems, guide implementation and architecture reviews, evaluate emerging technologies, promote responsible and sustainable AI, and help transition experiments into production-grade solutions.
Summary Generated by Built In

Who We Are

At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses.  We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.


The Role

Job Description

As a AI Architect at Kyndryl, you’ll play a key role in designing, refining, and implementing the architectures behind next-generation AI and Agentic AI solutions.

You’ll work at the intersection of innovation and engineering, translating strategic business objectives into tangible, enterprise-ready architectures that are scalable, secure, reliable, and maintainable.

You’ll collaborate with architects, data scientists, ML engineers, software engineers, cloud specialists, security teams, and business stakeholders to design systems that combine technological excellence with measurable business value — systems that are not only intelligent, but also trustworthy, traceable, governable, and sustainable.

Your Mission
  • Design and implement end-to-end AI and Agentic AI architectures that align business objectives with technical excellence.

  • Transform functional, analytical, and non-functional requirements into efficient, modular, scalable, and maintainable system designs.

  • Define architecture patterns covering areas such as AI agents, foundation models, data platforms, APIs, integration layers, orchestration, observability, security, and cloud infrastructure.

  • Collaborate with cross-functional teams to ensure solutions meet high standards of scalability, performance, resilience, security, and reliability.

  • Contribute to the creation of reference architectures, reusable components, design patterns, and technical standards that accelerate the delivery of AI solutions across the organization.

  • Act as a trusted technical partner throughout the solution lifecycle, contributing to architecture and design reviews and providing guidance during implementation.

  • Evaluate emerging technologies across the AI, Agentic AI, data, automation, and cloud ecosystems, identifying opportunities that can deliver tangible business value.

  • Ensure AI solutions integrate effectively with existing enterprise systems, data platforms, applications, APIs, and cloud environments.

  • Champion responsible AI and secure-by-design principles, embedding governance, traceability, privacy, security, and compliance into the architecture.

  • Promote sustainable engineering practices, considering cost efficiency, infrastructure utilization, model efficiency, operational complexity, and long-term maintainability when making architectural decisions.

  • Help bridge the gap between experimentation and production, ensuring AI concepts can evolve into robust, enterprise-grade solutions.


Who You Are

Essential Qualifications 

  • 3–6 years of experience in designing and implementing AI/ML solutions or advanced analytics architectures. 
  • Proven experience integrating AI models into production environments (APIs, microservices, or data pipelines). 
  • Solid understanding of AI and ML architectures, including model lifecycle (data ingestion, training, validation, deployment). 
  • Proficiency with cloud ecosystems (Azure, AWS, GCP) and their AI/ML services (e.g., Azure ML, Vertex AI, OpenShift AI). 
  • Hands-on experience with MLOps tools (MLflow, Kubeflow, Airflow) and container orchestration (Kubernetes, Docker). 
  • Familiarity with agentic AI frameworks (LangChain, CrewAI, AutoGen, LlamaIndex) and RAG architectures. 
  • Working knowledge of vector databases, APIs, and integration patterns for intelligent systems. 
  • Understanding of data privacy and regulatory frameworks (GDPR, EU AI Act, Responsible AI principles). 

 

Education & Certifications 

  • Bachelor’s or Master’s degree in Computer Engineering, Artificial Intelligence, Data Science, or related field. 
  • Postgraduate studies (Master’s or PhD) in AI, Big Data, or Cloud Computing are highly valued. 
  • Certifications in cloud architecture (Azure, AWS, or GCP) and MLOps frameworks are a plus. 
  • Continuous learning mindset and strong curiosity about emerging AI paradigms and technologies. 

Preferred Skills 

  • Experience designing modular, scalable, and maintainable architectures for AI-driven solutions. 
  • Knowledge of hybrid or federated AI deployments, integrating enterprise data and large language models. 
  • Exposure to observability and monitoring practices in AI workloads. 
  • Familiarity with semantic search, knowledge graphs, or LLM optimization pipelines. 
  • Experience collaborating in agile or DevOps environments, bridging data science and engineering teams. 
  • Ability to document and communicate architecture decisions clearly, supporting alignment across stakeholders. 
  • Curiosity to experiment with new frameworks and evaluate their maturity for enterprise adoption. 


Being You

The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.

What You Can Expect

Your career with us isn’t just a job—it’s an adventure with purpose.  We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best.
From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here—and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.

Get Referred!

If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.

Skills Required

  • 3-6 years of experience designing and implementing AI/ML solutions or advanced analytics architectures
  • Experience integrating AI models into production environments through APIs, microservices, or data pipelines
  • Understanding of AI and ML architectures, including data ingestion, training, validation, and deployment
  • Proficiency with Azure, AWS, or GCP and their AI/ML services
  • Hands-on experience with MLOps tools such as MLflow, Kubeflow, or Airflow
  • Experience with container orchestration using Kubernetes and Docker
  • Familiarity with agentic AI frameworks such as LangChain, CrewAI, AutoGen, or LlamaIndex
  • Knowledge of retrieval-augmented generation architectures
  • Working knowledge of vector databases, APIs, and integration patterns for intelligent systems
  • Understanding of data privacy and regulatory frameworks including GDPR, EU AI Act, and Responsible AI principles
  • Bachelor's or Master's degree in Computer Engineering, Artificial Intelligence, Data Science, or a related field
  • Postgraduate studies in AI, Big Data, or Cloud Computing
  • Certifications in Azure, AWS, or GCP cloud architecture
  • Certifications in MLOps frameworks
  • Experience designing modular, scalable, and maintainable AI-driven architectures
  • Knowledge of hybrid or federated AI deployments integrating enterprise data and large language models
  • Exposure to observability and monitoring practices for AI workloads
  • Familiarity with semantic search, knowledge graphs, or LLM optimization pipelines
  • Experience collaborating in agile or DevOps environments
  • Ability to document and clearly communicate architecture decisions

Kyndryl Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Kyndryl and has not been reviewed or approved by Kyndryl.

  • Fair & Transparent Compensation Pay is considered good in some roles, with mentions of “good pay,” “great pay and benefits,” and an “acceptable salary range” paired with bonuses. Certain senior or consulting tracks are described as market-competitive.
  • Leave & Time Off Breadth Vacation, paid time off, holidays, and a dedicated volunteer day are highlighted as positives. Parental leave exists companywide alongside sick leave and disability coverage.
  • Wellbeing & Lifestyle Benefits Remote and hybrid flexibility is emphasized, including 100% remote roles and a formal flexible workplace policy. Well‑being resources such as the Be Well program and an EAP are available.

Kyndryl Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
46,070 Employees
Year Founded: 2021

What We Do

We have the world’s best talent that design, run, and manage the most advanced and reliable technology infrastructure each day. Together, we think holistically about the health of these vital technology ecosystems. We are a focused, independent company that builds on our foundation of excellence by creating systems in new ways. Bringing in the right partners, investing in our business, and working side-by-side with our customers to unlock potential. We're raising the bar. Our experience speaks for itself: We have 90,000 highly skilled employees around the world serving 75 of the Fortune 100. But our purpose is what drives us: Advancing the vital systems that power human progress. Because when a digital ecosystem is healthy, it can more readily adapt and support continuous growth and that opens up a world of possibility for everyone.

Similar Jobs

Salesforce Logo Salesforce

Architect

Cloud • Software
In-Office
2 Locations
72000 Employees

GE Vernova Logo GE Vernova

Solutions Architect

Energy • Manufacturing • Solar • Renewable Energy
In-Office
7 Locations
75000 Employees
98K-164K Annually

GE Vernova Logo GE Vernova

Solutions Architect

Energy • Manufacturing • Solar • Renewable Energy
In-Office
7 Locations
75000 Employees
113K-189K Annually

Essity Logo Essity

Architect

Healthtech • Manufacturing
In-Office
4 Locations
17013 Employees

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account