About Mirantis
Mirantis is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure for modern AI, machine learning, and data-intensive applications. By combining open source innovation with deep expertise in Kubernetes orchestration, Mirantis empowers platform engineering teams to deliver composable, production-ready developer platforms across any environment—on-premises, in the cloud, at the edge, or in sovereign data centers. As enterprises navigate the growing complexity of AI-driven workloads, Mirantis delivers the automation, GPU orchestration, and policy-driven control needed to manage infrastructure with confidence and agility. Committed to open standards and freedom from lock-in, Mirantis ensures that customers retain full control of their infrastructure strategy.
Job Description
As Principal Software Engineer, you are the senior technical voice for Enterprise AI. You own its architecture together with the teams that share the platform, and set the technical bar for a small, senior, remote-first team.
Own the architecture across the AI gateway, control plane, model serving, identity, metering and observability, for hosted and installed editions.
Lead the gateway strategy, including the data plane choice and policy-based routing with per-request metering and audit records.
Set direction for LLM serving on Kubernetes: GPU scheduling and sharing, autoscaling, multi-tenant and disaggregated serving, and cost per token.
Define how enterprises run the product: Helm installs and upgrades, air-gapped networks, preflight checks and supply-chain security.
Run design reviews, make build vs. buy calls, and record decisions as ADRs.
Build hands-on in the critical path, and mentor senior engineers, including on AI-assisted development.
Work with design partners and customers, and represent Mirantis in the Kubernetes and ML-infrastructure communities.
10+ years in infrastructure or distributed systems, including several as technical lead.
Shipped multi-service systems that enterprises run in production, including software they install themselves.
Expert Kubernetes: operators, CRDs, scheduling, Helm, and debugging at scale.
Production experience with GPU workloads, LLM inference or AI gateways
Expert Go, strong Python, and solid CI/CD and infrastructure as code.
Leads through writing and influence, uses AI-assisted development tools fluently, and thrives with autonomy on a distributed team.
Nice to have
Inference performance work: quantization, batching, KV-cache management, disaggregated prefill and decode.
AI gateway or LLM routing: failover, rate limiting, token metering, policy enforcement.
Took a new product to its first enterprise customers.
Why you’ll love Mirantis
- Work with an established leader in the cloud infrastructure industry.
- Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies.
- Be a part of cutting-edge, open-source innovation.
- Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued.
- Receive a competitive compensation package with strong benefits plan.
- We are a Leader for Container Management in G2 (#2 after AWS)!
It is understood that Mirantis, Inc. may use automated decision-making technology (ADMT) for specific employment-related decisions. Opting out of ADMT use is requested for decisions about evaluation and review connected with the specific employment decision for the position applied for. You also have the right to appeal any decisions made by ADMT by sending your request to [email protected]
By submitting your resume, you consent to the processing and storage of your personal data in accordance with applicable data protection laws, for the purposes of considering your application for current and future job opportunities.
We are a Leader for Container Management in G2 (#2 after AWS)!
Skills Required
- 10+ years of experience in infrastructure or distributed systems, including several years as a technical lead
- Experience shipping multi-service systems used by enterprises in production, including self-installed software
- Expertise with Kubernetes operators, CRDs, scheduling, Helm, and debugging at scale
- Production experience with GPU workloads, LLM inference, or AI gateways
- Expertise in Go
- Strong Python skills
- Experience with CI/CD and infrastructure as code
- Ability to lead through writing and influence
- Fluency with AI-assisted development tools
- Ability to work autonomously on a distributed team
- Inference performance experience with quantization, batching, KV-cache management, or disaggregated prefill and decode
- Experience with AI gateways or LLM routing, including failover, rate limiting, token metering, or policy enforcement
- Experience taking a new product to its first enterprise customers
Mirantis Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Mirantis and has not been reviewed or approved by Mirantis.
-
Fair & Transparent Compensation — Pay is considered fair-to-good and competitive for certain technical and senior roles, and compensation is often viewed as a relative strength. Overall packages can feel solid in context, even if not universally top-of-market.
-
Healthcare Strength — Health coverage is described as comprehensive, including medical, dental, and vision, with employer-verified listings and mentions of strong coverage in practice. Core offerings align with what tech employees typically expect and are sometimes called out as a highlight.
-
Leave & Time Off Breadth — Policies include PTO, sick time, paid holidays, bereavement leave, and generous parental leave. These provisions are frequently characterized as generous and supportive of work-life balance.
Mirantis Insights
What We Do
We are dedicated to helping organizations increase developer productivity and ship code faster on public and private clouds. We provide a ZeroOps experience to remove the stress of managing cloud native infrastructure by combining software and automation tools with our cloud native expertise to deliver the industry's leading secure cloud platforms. Our capabilities allow us to provide a secure and reliable cloud native platform that includes validated FIPS-140-2 Encryption and DISA STIG ready capabilities. Who do we serve? We serve a wide range of industries, building on our extensive customer experience to provide distinct value in specific verticals including Financial Services, Government & Education, Healthcare, Manufacturing, and Telecommunications. Mirantis serves many of the world’s leading enterprises, including Adobe, DocuSign, Inmarsat, PayPal, Reliance Jio, Societe Generale, Splunk, and S&P Global. Learn more at www.mirantis.com.
