AI Systems Specialist

Posted 22 Hours Ago
Be an Early Applicant
2 Locations
In-Office
Mid level
Cloud • Information Technology • Consulting
The Role
Design and evolve an enterprise AI platform supporting secure, governed, model-agnostic runtimes, agent orchestration, MCP integration, deployment standards, and developer experience. Collaborate on Kubernetes, GPU infrastructure, model serving, networking, observability, governance, lifecycle management, evaluation, and cost optimization. Integrate AI agents with enterprise systems and advise engineering teams on scalable Agentic AI practices.
Summary Generated by Built In

Who We Are

At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses.  We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.


The Role

The AI Systems Specialist is part of the team for designing and evolving an enterprise-scale AI platform that enables engineering teams to build, deploy, and operate production-ready AI in a secure, governed, and reusable manner.

Key Responsibilities
  • Develop and maintain a platform that provides standardized runtime capabilities and Model Context Protocol (MCP) integration.
  • Define "Golden Paths" that standardize AI Platform and deployment across engineering teams.
  • Build a model-agnostic AI runtime supporting multiple LLM providers, AI gateways, and enterprise integrations.
  • Collaborate with infrastructure teams on Kubernetes, GPU platforms, networking, and cloud-native AI infrastructure.
  • Establish enterprise AI governance covering policy enforcement, security, prompt/model lifecycle management, human-in-the-loop workflows, evaluation, and cost optimization.
  • Integrate AI agents with enterprise platforms such as CI/CD, ITSM, observability, cloud services, and business applications.
  • Define engineering platform standards and development teams to help enterprise adoption of Agentic AI best practices.
Overall Focus

This is an advisory platform architecture role rather than an application development role. The emphasis is on building the foundational enterprise AI platform—including agent runtime, governance, orchestration, and developer experience—that enables multiple engineering teams to deliver scalable, secure, model-agnostic AI platform across the organization.


Your Future at Kyndryl
As an IT/Cloud Consultant at Kyndryl you will join the Kyndryl Consultant Profession, working with other Kyndryl Consultants, Architects, Project Managers, and cross-functional Technical Subject Matter Experts – presenting unlimited opportunities with unmatched support through our investment in your learning, training, and career growth.


Who You Are

Required Experience
  • 3+ years designing cloud-native platforms or enterprise software architectures.
  • Strong hands-on experience with AI architectures, orchestration, tool integration, memory, evaluation, and guardrails.
  • Experience with agent frameworks such as LangGraph, CrewAI, Semantic Kernel, or AutoGen.
  • Strong Python software engineering skills.
  • Experience in containers, Infrastructure as Code, and cloud-native architectures.
  • Understanding of AI infrastructure, including GPUs, model serving, AI gateways, and observability..
  • Professional proficiency in both English and Spanish.
Preferred Skills
  • Knowledge on LiteLLM, OpenRouter, NVIDIA NIM, vLLM, llm-d, or Triton Inference Server.
  • Knowledge of LLMOps, AI governance, and model lifecycle management.
  • Experience with RAG, vector databases, and semantic search.
  • Familiarity with observability tools such as Prometheus, Grafana, OpenTelemetry, or Langfuse.
  • Experience with AI coding assistants (Claude Code, GitHub Copilot, Codex).


Being You

The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.

What You Can Expect

Your career with us isn’t just a job—it’s an adventure with purpose.  We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best.
From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here—and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.

Get Referred!

If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.

Skills Required

  • 3+ years designing cloud-native platforms or enterprise software architectures
  • Hands-on experience with AI architectures, orchestration, tool integration, memory, evaluation, and guardrails
  • Experience with agent frameworks such as LangGraph, CrewAI, Semantic Kernel, or AutoGen
  • Strong Python software engineering skills
  • Experience with containers, Infrastructure as Code, and cloud-native architectures
  • Understanding of AI infrastructure, including GPUs, model serving, AI gateways, and observability
  • Professional proficiency in English and Spanish
  • Knowledge of LiteLLM, OpenRouter, NVIDIA NIM, vLLM, llm-d, or Triton Inference Server
  • Knowledge of LLMOps, AI governance, and model lifecycle management
  • Experience with RAG, vector databases, and semantic search
  • Familiarity with Prometheus, Grafana, OpenTelemetry, or Langfuse
  • Experience with AI coding assistants such as Claude Code, GitHub Copilot, or Codex

Kyndryl Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Kyndryl and has not been reviewed or approved by Kyndryl.

  • Fair & Transparent Compensation — Pay is considered good in some roles, with mentions of “good pay,” “great pay and benefits,” and an “acceptable salary range” paired with bonuses. Certain senior or consulting tracks are described as market-competitive.
  • Leave & Time Off Breadth — Vacation, paid time off, holidays, and a dedicated volunteer day are highlighted as positives. Parental leave exists companywide alongside sick leave and disability coverage.
  • Wellbeing & Lifestyle Benefits — Remote and hybrid flexibility is emphasized, including 100% remote roles and a formal flexible workplace policy. Well‑being resources such as the Be Well program and an EAP are available.

Kyndryl Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
46,070 Employees
Year Founded: 2021

What We Do

We have the world’s best talent that design, run, and manage the most advanced and reliable technology infrastructure each day. Together, we think holistically about the health of these vital technology ecosystems. We are a focused, independent company that builds on our foundation of excellence by creating systems in new ways. Bringing in the right partners, investing in our business, and working side-by-side with our customers to unlock potential. We're raising the bar. Our experience speaks for itself: We have 90,000 highly skilled employees around the world serving 75 of the Fortune 100. But our purpose is what drives us: Advancing the vital systems that power human progress. Because when a digital ecosystem is healthy, it can more readily adapt and support continuous growth and that opens up a world of possibility for everyone.

Similar Jobs

Pfizer Logo Pfizer

Director, Oncology Scientific Communications

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
34 Locations
121990 Employees
177K-294K Annually

Perk Logo Perk

Director of Field and Events Marketing

Artificial Intelligence • Fintech • Greentech • Sales • Software • Travel • Hospitality
Hybrid
2 Locations
1800 Employees

Perk Logo Perk

Account Manager

Artificial Intelligence • Fintech • Greentech • Sales • Software • Travel • Hospitality
Hybrid
Barcelona, Cataluña, ESP
1800 Employees

Perk Logo Perk

Account Executive

Artificial Intelligence • Fintech • Greentech • Sales • Software • Travel • Hospitality
Hybrid
Barcelona, Cataluña, ESP
1800 Employees

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity • Defense • Defense Technology
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account