Software Engineer - Infrastructure

Sorry, this job was removed at 06:42 p.m. (CST) on Thursday, Mar 26, 2026
Mountain View, CA, USA
Hybrid
145K-250K Annually
Artificial Intelligence • Cloud • Machine Learning • Software • Database
The Role
At Kumo, we're not just building another AI platform—we're fundamentally reinventing how enterprises extract value from their massive data investments. While companies pour millions into data lakehouses, the traditional ML approach has failed them with its painfully slow iterations, complex feature engineering, and disappointing results.

Our breakthrough? A revolutionary platform that harnesses the power of Graph Neural Networks through our elegant Predictive Query Language, allowing data scientists to unlock insights 12x faster with superior accuracy than conventional methods. We're on the front lines of AI, solving some of its most challenging and impactful problems, and we've already delivered over $500M+ in tangible value to industry giants like Reddit, DoorDash, and Databricks.

Your Mission

As an Infrastructure Engineer at Kumo, you'll architect the foundation that makes this AI revolution possible. You'll design and build scalable distributed systems that seamlessly bridge data warehouses with cutting-edge AI workflows, creating a platform that's both incredibly powerful and surprisingly simple to use.

Working alongside engineering leaders from top tech companies and researchers from Stanford, you'll solve complex technical challenges that few engineers get to tackle: building infrastructure that elegantly handles massive-scale data, complex AI training, and reliable inference—all while maintaining enterprise-grade security and performance. If you thrive in a fast-paced environment, are driven by ambitious goals, and crave an opportunity for massive impact, this is your chance to shape the future of AI.

Impact You'll Make:

  • Design and implement the core architecture of our distributed training and inference systems that can handle enterprise-scale data
  • Craft elegant integration points between data warehouses, AI processing engines, and our proprietary Graph transformer technology.
  • Build sophisticated orchestration systems that optimize computational resources while ensuring reliability and restartability.
  • Develop clean APIs and abstractions that decouple system components for rapid parallel development
  • Create scalable, cloud-native infrastructure that grows with our customers' needs while maintaining performance
  • Collaborate directly with customers to refine and iterate on real-world deployments

What You Bring:

  • Strong foundation in computer science (BS required, MS/PhD preferred) with 3-5+ years of software development experience
  • Deep understanding of distributed systems design principles
  • Proficiency in languages like Python, Java or C++
  • Problem-solving mindset with ability to tackle novel challenges in uncharted territory

What Sets You Apart:

  • Experience with cloud distributed storage, databases, and file systems (AWS, Azure)
  • Track record building and scaling microservices architectures
  • Knowledge of AI frameworks like PyTorch or TensorFlow, especially inference serving at scale
  • Contributions to open-source projects in distributed systems or data processing
  • Understanding of ML fundamentals, especially in enterprise applications.
  • Experience designing systems that elegantly handle failure modes and restarts
  • Hands-on experience with at least one major cloud (AWS / Azure / GCP) and Kubernetes at scale; multi-cloud exposure is a plus.

Benefits

  • Stock
  • Competitive Salaries
  • Medical Insurance
  • Dental Insurance 

Why Kumo?

Join us to work on technology that's genuinely changing how enterprises leverage AI. You'll build systems that unlock insights from previously untapped data, work with brilliant minds pushing the boundaries of ML, and create infrastructure that makes the impossible seem effortless.

At Kumo, we're not just building software—we're creating the foundation for the next generation of enterprise AI. Come architect the future with us.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Similar Jobs

Vercel Logo Vercel

Software Engineer

Artificial Intelligence • Cloud • Software
Easy Apply
Hybrid
2 Locations
180K-260K Annually

MongoDB Logo MongoDB

Software Engineer

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
4 Locations
5550 Employees
127K-249K Annually

Compa Logo Compa

Staff Software Engineer

Artificial Intelligence • HR Tech • Other • Software • Business Intelligence
In-Office
3 Locations
70 Employees
200K-225K Annually

Klaviyo Logo Klaviyo

Lead Software Engineer

Consumer Web • eCommerce • Marketing Tech • Retail • Software • Analytics • Generative AI
Easy Apply
Hybrid
San Francisco, CA, USA
2400 Employees
216K-324K Annually
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Mountain View, CA
38 Employees
Year Founded: 2021

What We Do

Democratizing AI on the Modern Data Stack! The team behind PyG (PyG.org) is working on a turn-key solution for AI over large scale data warehouses. We believe the future of ML is a seamless integration between modern cloud data warehouses and AI algorithms. Our ML infrastructure massively simplifies the training and deployment of ML models on complex data. With over 40,000 monthly downloads and nearly 13,000 Github stars, PyG is the ultimate platform for training and development of Graph Neural Network (GNN) architectures. GNNs -- one of the hottest areas of machine learning now -- are a class of deep learning models that generalize Transformer and CNN architectures and enable us to apply the power of deep learning to complex data. GNNs are unique in a sense that they can be applied to data of different shapes and modalities.

Similar Companies Hiring

Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account