Principal Engineer, IaaS

Posted 18 Minutes Ago
Be an Early Applicant
Chicago, IL, USA
In-Office
206K-275K Annually
Expert/Leader
Cloud • Information Technology • Machine Learning
We empower creators and innovators with access to GPU resources they need to work more efficiently.
The Role
Lead the technical direction and hands-on development of CoreWeave’s IaaS platform. Design scalable, multi-tenant compute, networking, and storage systems; optimize high-performance data paths; improve reliability, observability, and efficiency; and write production systems code. The role also requires cross-functional architectural leadership, mentorship, and collaboration across infrastructure and product teams supporting large-scale AI workloads.
Summary Generated by Built In
CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at www.coreweave.com.

About this role

We’re seeking a Principal Engineer to be a hands-on technical leader across our core Infrastructure-as-a-Service (IaaS) platform - the compute, high-performance networking, and storage foundation that every CoreWeave customer and product is built on. Your mission: make this infrastructure scale automatically and seamlessly while delivering the performance, reliability, and efficiency the world’s largest AI workloads demand. You’ll own everything from multi-tenant control and data planes to the low-level data path, prototype new capabilities, set engineering standards, and work shoulder-to-shoulder with compute, networking, storage, platform, and product teams to make CoreWeave the infrastructure platform for AI.

What you’ll do

  • Technical Vision & Strategy - Set technical direction for the IaaS org and make architectural decisions that influence systems well beyond any single team. Establish standards for how foundational infrastructure is designed, built, and operated.
  • Infrastructure Architecture - Design and implement highly scalable, multi-tenant control and data planes spanning compute, networking, and storage. Build foundational IaaS services including GPU and bare-metal compute provisioning, high-performance network fabrics, and exabyte-scale storage (S3-compatible object storage, block storage, and distributed filesystems), and integrate dedicated infrastructure into diverse customer environments.
  • Performance Engineering - Work across the data path with technologies such as RDMA, GPU Direct, RoCE, InfiniBand, SPDK, virtualization, and Kubernetes to optimize throughput, latency, and efficiency. Benchmark and eliminate bottlenecks across the compute, network, and storage layers.
  • Operational Excellence - Improve the reliability, durability, scalability, and observability of the platform end to end. Partner with operations teams to monitor, analyze, and optimize infrastructure using telemetry, metrics, and dashboards.
  • Hands-on Development - Write production code in a systems language (Go, C, C++, or Rust) for control planes, system services, and tooling. Stay deep in the low-level details that drive performance and durability.
  • Mentorship & Collaboration - Coach engineers on building distributed, high-performance systems, and work cross-functionally to deliver seamless, well-integrated infrastructure capabilities across the stack.

Who you are

  • 8-10+ years building infrastructure, distributed systems, or cloud services in production.
  • Strong hands-on experience operating large-scale systems across one or more core domains: compute and virtualization, high-performance networking, or storage (object, block, or distributed filesystems).
  • Proficiency in a systems programming language such as Go, C, C++, or Rust.
  • Solid understanding of cloud-native infrastructure, Kubernetes, and scalable system architecture.
  • Strong debugging and problem-solving skills in distributed, high-performance environments, with an instinct for where bottlenecks and failure modes live.
  • Excellent communicator who influences architecture across teams and distills complex trade-offs for engineers, executives, and customers.
  • Bachelor’s, Master’s, or PhD in CS, EE, or related field (or equivalent practical experience).

Nice-to-have

  • Experience with high-performance data-path technologies (RDMA, GPU Direct, RoCE, InfiniBand, SPDK) or large-scale provisioning, scheduling, and orchestration systems.
  • Familiarity with the trade-offs across infrastructure hardware choices, such as HDD vs SSD storage tiers and network fabric selection.
  • Background operating infrastructure for AI/ML or other GPU-accelerated, high-throughput workloads.
  • Publications/talks on large-scale distributed systems or infrastructure.

Why CoreWeave?

You’ll be a technical spearhead for the infrastructure that powers an industry-defining AI cloud, enabling researchers, enterprises, and OSS communities to run breakthrough models at massive scale. If building the world’s most performant, reliable, and scalable infrastructure platform excites you, we’d love to chat.


The base salary range for this role is $206,000 to $275,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility). 

What We Offer

In addition to a competitive salary, we offer a variety of benefits to support your needs. The benefits below reflect our US-based offerings for full-time employees; for roles in other locations, benefits vary and are shared during the hiring process. These include:

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance 
  • Voluntary supplemental life insurance 
  • Short and long-term disability insurance 
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement 
  • Ability to Participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health 
  • Family-Forming support provided by Carrot
  • Paid Parental Leave 
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • A casual work environment
  • A work culture focused on innovative disruption

California Applicants

California Consumer Privacy Act 

Equal Opportunity & Accommodations

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: [email protected].

Export Control Compliance

This position requires access to technology and/or source code subject to U.S. export control laws. Any such access will be provided only in compliance with applicable U.S. export control requirements. As part of the recruitment process, CoreWeave may request limited information reasonably necessary to assess applicable export-control requirements.

Skills Required

  • 8–10+ years building infrastructure, distributed systems, or cloud services in production
  • Hands-on experience operating large-scale compute and virtualization, high-performance networking, or storage systems
  • Proficiency in a systems programming language such as Go, C, C++, or Rust
  • Understanding of cloud-native infrastructure, Kubernetes, and scalable system architecture
  • Strong debugging and problem-solving skills in distributed, high-performance environments
  • Excellent communication skills and ability to influence architecture across teams
  • Bachelor’s, master’s, or PhD in computer science, electrical engineering, or a related field, or equivalent practical experience
  • Experience with RDMA, GPU Direct, RoCE, InfiniBand, SPDK, or large-scale provisioning, scheduling, and orchestration systems
  • Familiarity with HDD and SSD storage tiers and network fabric selection
  • Experience operating infrastructure for AI/ML or GPU-accelerated, high-throughput workloads
  • Publications or talks on large-scale distributed systems or infrastructure

What the Team is Saying

CoreWeave Compensation & Benefits Highlights

  • Affordable Benefits — Employee medical, dental, and vision premiums are described as 100% company-paid for U.S. staff, with an 80% subsidy for spouses/partners and dependents, materially reducing out-of-pocket costs. Feedback suggests this makes the healthcare offering a standout element of the package.
  • Retirement Support — A 401(k) plan with a company match of up to 4% is consistently advertised. This predictable contribution enhances long-term value alongside core pay.
  • Equity Value & Accessibility — Eligible U.S. employees can participate in an ESPP with a 15% discount, and some roles include equity awards. These features provide additional upside beyond salary, subject to plan terms and limits.

CoreWeave Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Livingston, NJ
1,450 Employees
Year Founded: 2017

What We Do

CoreWeave, the AI Hyperscaler™, delivers a cloud platform of cutting-edge software powering the next wave of AI. The company's technology provides enterprises and leading AI labs with cloud solutions for accelerated computing. Since 2017, CoreWeave has operated a growing footprint of data centers across the US and Europe. CoreWeave was ranked as one of the TIME100 most influential companies and featured on Forbes Cloud 100 ranking in 2024. Learn more at www.coreweave.com.

Why Work With Us

At CoreWeave we work hard, have fun and move fast! Today we are a small, growing team of intelligent, genuine people, that value different perspectives and approaches to solving complex problems. We foster an environment that champions collaboration and prioritizes innovative solutions. Here, you are surrounded by the best.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

CoreWeave Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Flexible
HQLivingston, NJ
Bellevue, WA
London, UK
New York, NY
Philadelphia, PA
Sunnyvale, CA
Learn more

Similar Jobs

CoreWeave Logo CoreWeave

Facilities Technical Manager - Elk Grove, IL

Cloud • Information Technology • Machine Learning
In-Office
Elk Grove, IL, USA
1450 Employees
122K-179K Annually

CoreWeave Logo CoreWeave

Construction Manager

Cloud • Information Technology • Machine Learning
In-Office
Chicago, IL, USA
1450 Employees
143K-191K Annually

CoreWeave Logo CoreWeave

Senior Construction Manager - Data Center Construction

Cloud • Information Technology • Machine Learning
In-Office
Chicago, IL, USA
1450 Employees
143K-210K Annually

CoreWeave Logo CoreWeave

Account Executive

Cloud • Information Technology • Machine Learning
In-Office
5 Locations
1450 Employees
187K-200K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account