Software Engineer, Cortex AI Infrastructure

Reposted Yesterday
Menlo Park, CA, USA
In-Office
160K-225K Annually
Mid level
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Database • Analytics
Let's build a world where data and AI turn possibilities into reality.
The Role
In this role, you will build high-performance AI orchestration engines, scale context engineering infrastructure, productionize AI workflows, and optimize system performance with a focus on complex backend infrastructure for enterprise AI systems.
Summary Generated by Built In

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done.

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers who are energized by the opportunity to reinvent how they work. The Cortex Apps team is building the future of AI for enterprise data, and this role focuses on the backend infrastructure that powers our flagship products like Snowflake Intelligence, Cortex

Agents, and Search. You won't just be using AI tools; you will be building the high-performance systems that orchestrate them, making agentic AI fast, reliable, scalable, and secure at the enterprise level.

What you will do in this role:

  • Build Agentic Runtimes: Help build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management.

  • Scale Context Engineering Infra: Develop and design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable search indexing, query processing, and semantic caching.

  • Develop the "Evals Engine": Build the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and experiments.

  • Productionize AI Workflows: Collaborate with the modeling team to take raw LLM capabilities and turn them into hardened, multi-tenant microservices with strict guardrails and observability.

  • Optimize Performance: Implement system optimizations for model routing, prompt caching, and token optimization to ensure maximum efficiency.

Requirements:

  • Education: Bachelor's degree in Computer Science or a related technical field; Masters or PhD preferred.

  • Experience: 4+ years of industry experience designing, building, and supporting distributed systems, high-throughput APIs, machine learning platforms, or data-intensive systems.

  • Technical Stack: Deep proficiency in Python (for AI orchestration) and strong experience with Go or Java (for systems). Familiarity with C++ is a plus.

  • Systems Thinking: Strong understanding of database internals, distributed state management, and cloud-native architecture (e.g., Kubernetes, FoundationDB). Experience setting up and maintaining CI/CD pipelines is a plus.

  • Domain Expertise: Familiarity with the "plumbing" of AI, such as vector indices, agent platforms, building scalable data pipelines, and working with frameworks like PyTorch, TensorFlow, or XGBoost.

  • Mindset: A growth mindset and excitement about breaking the status quo by seeking innovative solutions.

(Bonus) Experience with:

  • Query optimization and SQL engine internals.

  • Designing multi-tenant systems that handle sensitive enterprise data at scale.

  • Developing search infrastructure for large-scale applications

Every Snowflake employee is expected to follow the company’s confidentiality and security standards for handling sensitive data. Snowflake employees must abide by the company’s data security plan as an essential part of their duties. It is every employee’s duty to keep customer information secure and confidential.

Snowflake is growing fast, and we’re scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.

How do you want to make your impact?

For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com

Skills Required

  • Bachelor's degree in Computer Science or a related technical field
  • 4+ years of industry experience designing, building, and supporting distributed systems
  • Deep proficiency in Python
  • Strong experience with Go or Java
  • Familiarity with database internals and distributed state management

Snowflake Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Snowflake and has not been reviewed or approved by Snowflake.

  • Equity Value & Accessibility Equity grants (RSUs) and an ESPP are central to total compensation and are described as highly valuable. Feedback suggests many see equity as a major satisfaction driver with meaningful upside potential.
  • Fair & Transparent Compensation Pay is considered competitive and accompanied by clear communication on salary, equity, and advancement. Feedback suggests pay practices emphasize fairness and transparency.
  • Parental & Family Support Paid parental leave, fertility benefits, adoption assistance, and family planning resources are notably comprehensive. Feedback suggests these programs materially support major life events.

Snowflake Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Bozeman, MT
9,023 Employees
Year Founded: 2012

What We Do

Snowflake powers the end-to-end data lifecycle – from ingesting and processing data to analyzing and modeling it, to building and sharing data and AI applications – helping engineers, analysts, and leaders innovate faster and achieve more with their data. We're on a mission to empower every enterprise to achieve its full potential through data and AI.

Why Work With Us

Snowflake is where data does more, and so do you. More innovating, more growing, and more collaborating. Here, you’ll find the sweet spot between building big and moving fast, in technology and your career.

Gallery

Gallery

Similar Jobs

Snowflake Logo Snowflake

Staff Software Engineer

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Database • Analytics
In-Office
Menlo Park, CA, USA
9023 Employees
236K-339K Annually

Chime Logo Chime

Senior Associate, Product Compliance

Fintech • Machine Learning • Mobile • Security • Software
Easy Apply
Hybrid
3 Locations
1500 Employees
101K-140K Annually

Samsara Logo Samsara

Sales Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
198K-233K Annually

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Retail Contingent

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Milpitas, CA, USA
16000 Employees
15-24 Hourly

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account