Senior Platform Engineer, AI Infrastructure

Posted 9 Hours Ago
Be an Early Applicant
Chicago, IL, USA
In-Office
185K-225K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Mobile • Software • Consulting
Building agentic AI and custom software.
The Role
Lead the architecture and delivery of an enterprise AI platform supporting LLM and agentic workloads. Design multi-tenant Kubernetes infrastructure across Azure and GCP, GPU capacity, Terraform modules, CI/CD, GitOps, security controls, model-serving services, and governance. Mentor a platform engineer, lead architecture reviews, advise client stakeholders, and establish operational standards for production AI infrastructure.
Summary Generated by Built In

Who we are:

At Focused, we move quickly to deliver quality software that achieves client outcomes and meets their customer's needs. We strategically partner with our clients to leverage our expertise in design and software, while our clients bring their own domain expertise. We work with a variety of clients from different industries, collaborating as we get new products to market, modernizing legacy systems, or helping teams learn the skills they need to be successful.

Our values:

  • Listen first • We are experts in product practices but lifelong learners in the domain of our customers. We research, collaborate, and understand.
  • Learn why • We ask questions and talk to users to understand problem spaces, objectives, and goals, which allows us to deeply invest and drive towards the outcomes of our clients.
  • Love your craft • We love diving into a variety of domains and solving problems. We take pride in delivering value, in communicating progress, and guiding our clients to success.

We're looking for a Senior Platform Engineer to lead the build-out of an enterprise AI platform for a global enterprise client. You'll design the foundation their teams use to ship LLM applications and agents: Kubernetes, GPU capacity, security, and the guardrails that let hundreds of engineers move fast without breaking things. You'll set technical direction and mentor a Platform Engineer working alongside you.

Key Responsibilities:

AI Platform Architecture

  • Design and build a multi-tenant platform for LLM and agentic AI workloads, from model access to deployment
  • Architect GPU infrastructure for inference and fine-tuning, including scheduling, autoscaling, and cost controls
  • Stand up shared services for agents: model gateways, secrets, tracing, evaluation, and deployment pipelines
  • Make build-vs-buy calls and explain the tradeoffs to technical and executive stakeholders

Kubernetes & Cloud Infrastructure

  • Architect and run production Kubernetes on Azure AKS and GCP GKE
  • Own Terraform modules and IaC standards across environments
  • Build CI/CD and GitOps workflows that make platform changes safe and repeatable

Security & Governance

  • Design identity, network isolation, and secrets management for AI workloads
  • Put guardrails in place for data access, model usage, and auditability
  • Partner with security and compliance teams to meet enterprise requirements

Leadership & Consulting

  • Mentor and direct a Platform Engineer on the engagement
  • Lead architecture reviews and write the decision records that outlast the engagement
  • Build trust with client engineering leaders and leave their team able to run what we build

Required Qualifications:

  • 10+ years in infrastructure, platform, or DevOps engineering
  • Deep production experience with Kubernetes, including Azure AKS
  • Hands-on experience with GCP
  • Expert-level Terraform
  • Experience running GPU infrastructure (NVIDIA GPU Operator, node pools, scheduling, or similar)
  • Experience building infrastructure that supports LLM workloads in production
  • Strong cloud security background: IAM, networking, secrets, policy as code
  • Experience leading technical direction for a team

Preferred Qualifications (Exceptional Candidates):

  • Experience building an internal agentic AI platform
  • Familiarity with model serving (vLLM, Triton, KServe, Ray Serve)
  • Experience with Azure OpenAI or Vertex AI
  • Consulting or client-facing experience

What Sets Exceptional Candidates Apart:

  • You've built a platform other engineering teams chose to adopt
  • You've cut GPU spend meaningfully without slowing teams down
  • You can explain a platform architecture to a CTO and a junior engineer in the same meeting

What to know before you apply:

  • This role will require being in the Chicago office 3 days per week and up to 20% travel within the United States.
  • Focused is unable to sponsor or take over sponsorship of the employment Visa process at this time.
  • The Chicago base salary range for this role is $185,000 - $225,000.

Skills Required

  • 10+ years of experience in infrastructure, platform, or DevOps engineering
  • Deep production experience with Kubernetes, including Azure AKS
  • Hands-on experience with GCP
  • Expert-level Terraform experience
  • Experience running GPU infrastructure, including NVIDIA GPU Operator, node pools, scheduling, or similar
  • Experience building production infrastructure supporting LLM workloads
  • Strong cloud security background, including IAM, networking, secrets, and policy as code
  • Experience leading technical direction for a team
  • Experience building an internal agentic AI platform
  • Familiarity with model serving technologies such as vLLM, Triton, KServe, or Ray Serve
  • Experience with Azure OpenAI or Vertex AI
  • Consulting or client-facing experience

Focused Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Focused and has not been reviewed or approved by Focused.

  • Parental & Family Support — Paid leave is offered for both birth and non-birth parents, with a structured transition period to ease the return to work. Adoption assistance and company-sponsored family events reinforce a family-friendly environment.
  • Retirement Support — A 401(k) plan includes employer matching with no vesting period, supporting long-term savings. The presence of a clear match structure signals a stable retirement benefit.
  • Leave & Time Off Breadth — Generous PTO combines vacation, sick days, and floating holidays to support work-life balance. Company materials emphasize using time off and taking breaks to maintain wellbeing.

Focused Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Chicago, IL
34 Employees
Year Founded: 2018

What We Do

Focused is a software services company that builds agentic AI and custom software. Our expert engineers and designers build custom agents that integrate seamlessly with the systems you already run. What sets Focused apart is our hands-on, collaborative approach. We don’t just build and deliver software, we partner with your teams to ensure that we are building the right solution to meet both present and future demands.

Why Work With Us

We love to write code, and if you do too, you will love Focused. Everything we do from our sustainable pace to minimal meetings is designed to optimize your time writing software! Focused is truly a place to grow or hone your software craft - you could see 2-3 clients in a year and each one presents things to learn.

Gallery

Gallery

Similar Jobs

Hybrid
Chicago, IL, USA
205000 Employees
23-31 Hourly

Wells Fargo Logo Wells Fargo

Senior Premier Banker Evanston IL

Fintech • Financial Services
Hybrid
Evanston, IL, USA
205000 Employees
37K-66K Hourly

Wells Fargo Logo Wells Fargo

Associate Bank Financial Advisor

Fintech • Financial Services
Hybrid
Chicago, IL, USA
205000 Employees

ABN AMRO Clearing USA LLC Logo ABN AMRO Clearing USA LLC

Operations Officer (Equities)

Information Technology • Professional Services • Financial Services
Hybrid
Chicago, IL, USA
215 Employees
75K-75K Annually

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account