Senior Software Engineer — Distributed Compute / Spark Systems

Posted 2 Months Ago
Mountain View, CA, USA
Hybrid
160K-240K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
Better Data for Better AI
The Role
Build and optimize distributed compute infrastructure for large-scale analytical and AI workloads. Responsibilities include improving query execution, scheduling, resource allocation, reliability, workload routing, and compute efficiency across Spark and related systems. The role involves debugging performance bottlenecks, optimizing joins, scans, shuffles, caching, partitioning, and memory usage, and working with lakehouse formats and cloud object storage. Candidates will implement workload optimization algorithms and may contribute to open source or research.
Summary Generated by Built In
Senior Software Engineer — Distributed Compute / Spark Systems
 
Location: Mountain View, CA — Downtown HQ

Employment Type: Full-time

Work Model: On-site, 5 days/week

Department: Research

 
About Granica

Granica helps enterprises run AI for less, from the data layer to agent execution.

Granica is building across three related layers:

  • Crunch reduces storage and processing costs across enterprise data infrastructure.

  • Large Tabular Models unlock predictions and generated data from governed enterprise tables.

  • Myelin reduces token and compute overhead for long-running AI agents.

 

Everything runs inside the customer’s perimeter, so enterprises retain control of their data and the intelligence it creates.

 

Granica has already processed hundreds of petabytes of enterprise data in production for customers including Snap, Pinterest, Lyft, and ShareChat.

 

Our research organization is led by Stanford Professor Andrea Montanari.

 

We operate at the intersection of data infrastructure, AI systems, and applied research, building the efficiency and intelligence layer for enterprise AI.

About the Role

Granica is hiring a Senior Software Engineer to build distributed compute systems for enterprise-scale data and AI workloads.

You will work on the core infrastructure behind Crunch, Granica’s continuous optimization product for enterprise lakehouse data. This includes systems for distributed execution, workload optimization, query performance, scheduling, resource management, and compute cost reduction across petabyte- and exabyte-scale environments.

You will own core systems that directly affect customer compute spend, query latency, workload reliability, cluster efficiency, and the performance of large-scale analytical data processing.

This is a hands-on systems role for engineers who have gone deep on distributed execution — particularly Apache Spark or similar query/runtime systems — and want to own performance, scheduling, reliability, and compute efficiency at massive scale.

What You’ll Do
  • Build and optimize distributed compute infrastructure for large-scale analytical and AI workloads

  • Improve execution performance across scans, joins, aggregations, shuffles, spills, caching, partitioning, and task scheduling

  • Design adaptive systems for workload routing, execution planning, resource allocation, and cluster efficiency

  • Debug bottlenecks across CPU, memory, network, storage, metadata, and distributed execution layers

  • Improve reliability, fault tolerance, and compute efficiency across Spark and adjacent systems such as Trino, Presto, Flink, Iceberg, Delta Lake, Hudi, and cloud object stores

What We’re Looking For
  • Deep engineering experience in distributed systems, query engines, databases, or cloud infrastructure

  • Production experience building, extending, or deeply optimizing distributed compute or query systems such as Spark, Spark SQL, Trino, Presto, Flink, or similar execution engines

  • Strong understanding of distributed execution, query planning, scheduling, resource management, fault tolerance, workload isolation, and performance optimization

  • Hands-on experience with Spark internals such as Catalyst, Adaptive Query Execution, shuffle, joins, aggregation, spill, memory management, or task scheduling

  • Strong programming skills in Scala, Java, Go, Rust, C++, or a similar systems-oriented language, with a pragmatic end-to-end builder mindset

Bonus
  • Contributions to Spark, Trino, Presto, Flink, Velox, DuckDB, DataFusion, Iceberg, Delta Lake, Hudi, Parquet, ORC, or related systems

  • Experience with cost-based optimization, vectorized execution, workload schedulers, execution control planes, resource managers, storage-aware execution, or adaptive query optimization

  • Research or open-source contributions in distributed systems, databases, query processing, data processing, or cloud infrastructure

Why Join Granica
  • Build foundational infrastructure for enterprise data and AI

  • Work on deep systems problems across distributed compute, query execution, scheduling, and compute efficiency

  • Own meaningful parts of the architecture in a small, high-caliber engineering team

  • Work directly with Product, Engineering, and company leadership

  • Have direct impact on customer performance, infrastructure cost, product direction, and company growth

Compensation & Benefits
  • Competitive salary, meaningful equity, and performance bonus for top performers

  • 401(k) with company match, comprehensive health coverage, and unlimited PTO

  • Daily catered meals in our Mountain View office

  • Support for research, publication, and conference participation

At Granica, you'll help build the next generation of enterprise AI—from exabyte-scale data infrastructure, Large Tabular Models (LTMs), and stateful AI agents. Together, we're creating the infrastructure that enables enterprises to own their data, own the intelligence built on it, and scale both efficiently.

 

Skills Required

  • Strong engineering depth in distributed systems, data processing systems, query engines, databases, or cloud infrastructure
  • Production experience with distributed compute or query systems such as Apache Spark, Spark SQL, Trino, Presto, Flink, Databricks, EMR, Glue, or Hive
  • Hands-on experience improving performance, reliability, or cost efficiency for large-scale data-processing workloads
  • Understanding of distributed execution, query planning, scheduling, resource management, fault tolerance, and workload isolation
  • Experience with Spark internals, Spark SQL, Catalyst, Adaptive Query Execution, shuffle, joins, aggregation, spill, memory management, or task scheduling
  • Familiarity with lakehouse formats and columnar data such as Iceberg, Delta Lake, Hudi, Parquet, or ORC
  • Familiarity with cloud object storage systems such as S3, GCS, or ADLS and their distributed-compute performance tradeoffs
  • Strong programming skills in Scala, Java, Go, Rust, C++, or similar systems-oriented languages
  • Curiosity about workload optimization, cost modeling, adaptive execution, and compute efficiency for AI and analytics at scale
  • Pragmatic builder mindset with rigorous, hands-on ownership of complex systems end to end
  • Experience contributing to Apache Spark, Spark SQL, Trino, Presto, Flink, Velox, DuckDB, DataFusion, Iceberg, Delta Lake, Hudi, Parquet, ORC, or related systems
  • Experience with cost-based optimization, query planning, vectorized execution, or distributed runtime systems
  • Experience optimizing joins, aggregations, shuffles, scans, spills, caching, partitioning, skew handling, or task scheduling
  • Experience building workload schedulers, execution control planes, resource managers, or multi-engine compute platforms
  • Experience reducing compute cost or improving workload efficiency in large-scale production data environments
  • Background in query engines, distributed runtimes, storage-aware execution, indexing, caching, encoding, compression, or adaptive query optimization
  • Research or open-source contributions in distributed systems, databases, query processing, data processing, or cloud infrastructure
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Mountain View, California
45 Employees
Year Founded: 2023

What We Do

Our mission is to remove inefficiency from the foundation of AI. By combining new research in information theory, probabilistic modeling, and distributed systems, we’re creating self-optimizing data infrastructure that continuously improves how information is represented and used by intelligent systems.

Why Work With Us

We’re a tight-knit team combining --> * Fundamental research in compression, data systems, and information theory * World-class systems engineering across storage, infrastructure, and research led by our Chief Scientist & Stanford Prof. Andrea Montanari * A shared obsession with performance, scale, and clean design

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Granica Offices

OnSite Workspace

Typical time on-site:
HQMountain View, California
India
Learn more

Similar Jobs

Granica Logo Granica

Head Of Marketing

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
In-Office
Mountain View, CA, USA
45 Employees

Granica Logo Granica

Senior Software Engineer

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
In-Office
Mountain View, CA, USA
45 Employees
160K-240K Annually

Granica Logo Granica

Head of Finance — Strategic Finance & Corporate Development

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
In-Office
Mountain View, CA, USA
45 Employees
140K-180K Annually

Granica Logo Granica

Scientist

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
In-Office
Mountain View, CA, USA
45 Employees
160K-240K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account