Engineer, Platform Engineering - AI

Posted 4 Hours Ago
Be an Early Applicant
Atlanta, GA, USA
In-Office
Mid level
Financial Services
The Role
Deploys and operates AI/ML platform infrastructure, including GPU clusters, Kubernetes environments, container images, CUDA tooling, vector stores, RAG pipelines, agent memory systems, MCP servers, and agentic AI workflows. Responsibilities include monitoring, security controls, automation, technical troubleshooting, incident response, production support, documentation, vendor escalation, and on-call operations. The role also supports developers and operations teams while improving platform reliability and efficiency.
Summary Generated by Built In
Job Description

Job Purpose

We are on a mission as a team.  We are problem solvers and partners, always starting with our customers to solve their challenges and create opportunities.  Our start-up roots keep us nimble, flexible, and moving fast.  We take ownership and make decisions. We all work for one company and work together to drive growth across the business.  We engage in robust debates to find the best path, and then we move forward as one team.  We take pride in what we do, acting with integrity and passion, so that our customers can perform better.  We are experts and enthusiasts - combining ever-expanding knowledge with leading technology to consistently deliver results, solutions and opportunities for our customers and stakeholders.   Every day we work toward transforming global markets.


The AI Platform Engineer is responsible for the technical implementation, maintenance, and optimization of AI/ML infrastructure. This hands-on role focuses on GPU cluster deployment, container image management, platform tooling development, and deep technical troubleshooting. In addition, the engineer deploys and maintains AI-enabled workflow automation tools across LLM, MCP, and agentic capabilities, ensuring these systems operate efficiently and securely within a containerized architecture. This includes deploying and maintaining vector store infrastructure, implementing end-to-end RAG workflows, tuning agent memory systems, and hosting and managing MCP servers. The engineer also deploys and operates Agentic AI systems, including multi-agent orchestration frameworks and tool-use pipelines. The engineer serves as a core technical contributor on the AI Platform Operations team, translating architectural decisions into working infrastructure and enabling advanced, automated workflows across the platform.


Responsibilities

  • Deploy, configure, and maintain GPU clusters and associated infrastructure
  • Designing, building, and maintaining the workflow automation platform that uses AI capabilities (LLM/MCP/Agentic capabilities)
  • Manage NVIDIA driver versions, CUDA toolkits, and container runtimes
  • Build and maintain approved container images with ML frameworks (PyTorch, TensorFlow, etc.)
  • Implement monitoring, alerting, and observability for GPU infrastructure
  • Deploy and maintain vector store infrastructure for RAG pipelines, agent memory, and semantic search
  • Implement and maintain end-to-end RAG workflows, including document ingestion, chunking, embedding generation, and retrieval optimization
  • Maintain and tune agent memory systems, including short-term context windows, long-term persistent memory stores, and episodic memory retrieval patterns
  • Deploy, operate, and maintain Agentic AI systems, including multi-agent orchestration frameworks and tool-use pipelines
  • Deploy, host, and maintain MCP servers within the containerized platform infrastructure
  • Manage MCP server configurations, versioning, access controls, and integration with agentic workflows
  • Monitor MCP server health, performance, and availability; respond to incidents and perform root cause analysis
  • Develop automation and tooling to improve platform reliability and efficiency
  • Provide L2/L3 technical support and vendor escalation for complex issues
  • Implement security controls including network policies, RBAC, and secrets management
  • Execute change requests and maintain technical documentation
  • Respond to and assist in production operations in a 24/7 environment
  • Provide technical analysis, resolve problems, and propose solutions
  • Provide support to, and coordinate with, developers, operations staff, release engineers, and end-users
  • Educate and mentor team members and operations staff
  • Participate in a weekly on-call rotation for after-hours support

Knowledge and Experience

  • Bachelor's degree preferred.
  • 3+ years in infrastructure engineering, systems administration, or DevOps
  • 3+ years in scripting and automation skills (Python, Ansible, GitOps)
  • 3+ years hands-on experience with Kubernetes in production
  • 2+ years experience with Linux administration
  • Direct experience with GPU infrastructure (NVIDIA preferred)
  • 1+ years experience using CUDA
  • 1+ years experience using MCPs
  • 1+ years experience with vector databases and embedding infrastructure
  • 1+ years experience with RAG pipeline design and deployment
  • 1+ years experience with agent memory patterns (in-context, external stores, retrieval-augmented memory)
  • 1+ years experience with agentic AI systems using orchestration frameworks
  • 1+ years experience with semantic search, embedding models, and ANN search techniques
  • 1+ years working with workflow/orchestrion automation tools
  • Experience with enterprise monitoring and observability tools
  • Ability to work in a service-oriented team environment
  • Project Management, organization, and time management
  • Customer focused, and dedicated to the best possible user experience
  • Communicate effectively with both technical and business resources
  • Fluent speaking, reading, and writing in English

Desired Knowledge and Experience 

  • 1+ years of experience with AI developer toolkits (NVIDIA drivers, CUDA, cuDNN, and NCCL)
  • 1+ years of experience with Run:AI, NVIDIA AI Enterprise, or DGX systems
  • 1+ years of experience with n8n
  • 1+ years of experience with GitHub Actions

#LI-SH3

#LI-ONSITE

----------Intercontinental Exchange, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to legally protected characteristics.

Skills Required

  • 3+ years in infrastructure engineering, systems administration, or DevOps
  • 3+ years of scripting and automation experience with Python, Ansible, or GitOps
  • 3+ years of hands-on Kubernetes experience in production
  • 2+ years of Linux administration experience
  • Direct experience with GPU infrastructure, preferably NVIDIA
  • 1+ year of CUDA experience
  • 1+ year of MCP experience
  • 1+ year of experience with vector databases and embedding infrastructure
  • 1+ year of RAG pipeline design and deployment experience
  • 1+ year of experience with agent memory patterns
  • 1+ year of experience with agentic AI systems and orchestration frameworks
  • 1+ year of experience with semantic search, embedding models, and ANN search techniques
  • 1+ year of experience with workflow automation tools
  • Experience with enterprise monitoring and observability tools
  • Ability to work in a service-oriented team environment
  • Effective project management, organization, and time management skills
  • Customer-focused approach and commitment to user experience
  • Effective communication with technical and business resources
  • Fluent English speaking, reading, and writing
  • Bachelor's degree
  • 1+ year of experience with NVIDIA drivers, CUDA, cuDNN, and NCCL
  • 1+ year of experience with Run:AI, NVIDIA AI Enterprise, or DGX systems
  • 1+ year of experience with n8n
  • 1+ year of experience with GitHub Actions
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Atlanta, GA
4,631 Employees
Year Founded: 2001

What We Do

ICE (NYSE: ICE) connects people to data, technology and expertise that create opportunity and inspire innovation.

Similar Jobs

In-Office
Atlanta, GA, USA
4631 Employees
134K-180K Annually

Enverus Logo Enverus

Utility 3D Modeling & Design Manager - 26460

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
5 Locations
1800 Employees
120K-140K Annually

Enverus Logo Enverus

Territory Manager - 26-175

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
3 Locations
1800 Employees
60K-70K Annually

Enverus Logo Enverus

Territory Manager, Business Relations - 26390

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
5 Locations
1800 Employees
80K-175K Annually

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account