Senior Software Engineer

Posted 4 Hours Ago
Hiring Remotely in Raleigh, NC, USA
In-Office or Remote
Senior level
Software
The Role
Design and build Kubernetes-based LLM serving infrastructure, including GPU scheduling, scaling, model lifecycle management, enterprise Helm deployments, API and identity integrations, metering, and GPU inference observability. Contribute across a multi-service Go codebase, create design documentation, participate in reviews, and help guide engineering direction. The role also supports restricted-network deployments and may involve inference optimization, distributed serving, and management UI development.
Summary Generated by Built In
Company Description

About Mirantis

Mirantis is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure for modern AI, machine learning, and data-intensive applications. By combining open source innovation with deep expertise in Kubernetes orchestration, Mirantis empowers platform engineering teams to deliver composable, production-ready developer platforms across any environment—on-premises, in the cloud, at the edge, or in sovereign data centers. As enterprises navigate the growing complexity of AI-driven workloads, Mirantis delivers the automation, GPU orchestration, and policy-driven control needed to manage infrastructure with confidence and agility. Committed to open standards and freedom from lock-in, Mirantis ensures that customers retain full control of their infrastructure strategy.

 

Job Description

Mirantis is building a new enterprise AI infrastructure product that lets organizations run and govern large language models on their own Kubernetes clusters. You will join a small senior team early, with broad ownership of the model-serving layer and its path to production.

What you'll do

  • Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.

  • Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.

  • Integrate the serving layer with the platform's API gateway, identity, and metering services.

  • Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).

  • Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.

Qualifications

  • 5+ years of software engineering experience in infrastructure, platform, or distributed systems.

  • Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts, not just consuming managed clusters.

  • Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast.

  • Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.

  • Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily engineering workflow.

  • Comfortable with high autonomy on a small, remote-first, written-culture team.

Nice to have

  • Inference performance work (quantization, batching, caching) or distributed serving frameworks.

  • Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security.

  • UI development experience (e.g. React/TypeScript), useful as the product's management surfaces grow.

  • Open-source contributions in the Kubernetes or ML-infrastructure ecosystems.

 

Additional Information

Why you’ll love Mirantis

  • Work with an established leader in the cloud infrastructure industry.
  • Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies.
  • Be a part of cutting-edge, open-source innovation.
  • Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued.
  • Receive a competitive compensation package with strong benefits plan.
  • We are a Leader for Container Management in G2 (#2 after AWS)!

It is understood that Mirantis, Inc. may use automated decision-making technology (ADMT) for specific employment-related decisions. Opting out of ADMT use is requested for decisions about evaluation and review connected with the specific employment decision for the position applied for. You also have the right to appeal any decisions made by ADMT by sending your request to [email protected]

By submitting your resume, you consent to the processing and storage of your personal data in accordance with applicable data protection laws, for the purposes of considering your application for current and future job opportunities.

We are a Leader for Container Management in G2 (#2 after AWS)!

Skills Required

  • 5+ years of software engineering experience in infrastructure, platform, or distributed systems
  • Deep hands-on Kubernetes experience building and operating production workloads and Helm charts
  • Experience with GPU workloads or LLM inference, or strong adjacent systems experience with demonstrated ability to learn quickly
  • Strong Go programming skills
  • Solid CI/CD and infrastructure-as-code skills
  • Fluency with AI-assisted development tools such as Claude Code or OpenAI Codex
  • Ability to work autonomously on a small, remote-first, written-culture team
  • Inference performance experience, including quantization, batching, caching, or distributed serving frameworks
  • Enterprise deployment experience with air-gapped installations, SSO/OIDC, or supply-chain security
  • UI development experience with React or TypeScript
  • Open-source contributions in Kubernetes or ML-infrastructure ecosystems

Mirantis Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Mirantis and has not been reviewed or approved by Mirantis.

  • Fair & Transparent Compensation — Pay is considered fair-to-good and competitive for certain technical and senior roles, and compensation is often viewed as a relative strength. Overall packages can feel solid in context, even if not universally top-of-market.
  • Healthcare Strength — Health coverage is described as comprehensive, including medical, dental, and vision, with employer-verified listings and mentions of strong coverage in practice. Core offerings align with what tech employees typically expect and are sometimes called out as a highlight.
  • Leave & Time Off Breadth — Policies include PTO, sick time, paid holidays, bereavement leave, and generous parental leave. These provisions are frequently characterized as generous and supportive of work-life balance.

Mirantis Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Campbell, CA
729 Employees
Year Founded: 1999

What We Do

We are dedicated to helping organizations increase developer productivity and ship code faster on public and private clouds. We provide a ZeroOps experience to remove the stress of managing cloud native infrastructure by combining software and automation tools with our cloud native expertise to deliver the industry's leading secure cloud platforms. Our capabilities allow us to provide a secure and reliable cloud native platform that includes validated FIPS-140-2 Encryption and DISA STIG ready capabilities. Who do we serve? We serve a wide range of industries, building on our extensive customer experience to provide distinct value in specific verticals including Financial Services, Government & Education, Healthcare, Manufacturing, and Telecommunications. Mirantis serves many of the world’s leading enterprises, including Adobe, DocuSign, Inmarsat, PayPal, Reliance Jio, Societe Generale, Splunk, and S&P Global. Learn more at www.mirantis.com.

Similar Jobs

Vannevar Logo Vannevar

Senior Software Engineer

Artificial Intelligence • Machine Learning • Software • Defense
Remote
USA
225 Employees

Affirm Logo Affirm

Senior Software Engineer

Big Data • Fintech • Mobile • Payments • Financial Services
Easy Apply
Remote
United States
2200 Employees
173K-255K Annually

Affirm Logo Affirm

Senior Software Engineer

Big Data • Fintech • Mobile • Payments • Financial Services
Easy Apply
Remote
United States
2200 Employees
173K-255K Annually

MongoDB Logo MongoDB

Senior Software Engineer

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
United States
5550 Employees
126K-264K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account