Senior Software Engineer

Posted 8 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
175K-250K Annually
Senior level
Artificial Intelligence • Machine Learning • Software • Generative AI
The Role
Design and implement core, high-performance services for an enterprise-scale AI policy engine. Own architecture and APIs, make tradeoffs across correctness, consistency, availability and latency, and work across stack from data models to product surface to ensure auditable, reliable governance under concurrent load.
Summary Generated by Built In
About CTGT & The Mission

Despite massive investment in commercial AI, organizations often find that demonstrated value is elusive, primarily due to the non-deterministic risk inherent to generative models. CTGT is the deterministic governance layer that enables the most important global institutions to deploy AI workflows with confidence.

Born out of Stanford University research, we provide the control plane that makes it possible. A lightweight, model-agnostic system that enforces policy, prevents drift, and produces auditable decisions in real time. When benchmarked on HaluEval, the CTGT Policy Engine (paired with GPT-120B OSS) outperformed frontier models (Gemini 3 Pro Preview, Claude 4.5 Opus and 4.5 Sonnet) at drastically lower compute cost.

While we sit on the edge of AI research, CTGT brings frontier intelligence into real-world environments. We apply cutting-edge theory directly in production to make large language models more reliable, controllable, and performant in practice.

Our mission is to bring models to the level of performance and accountability required by the Fortune 500. By bridging the gap between LLM capabilities and domain-specific requirements, we unlock the true potential of generative AI to solve the most pressing problems in our world today.

The Role

CTGT's mission is to deploy high-performance model governance at enterprise scale. This places rigorous requirements on our system. Our Policy Engine must produce decisions that are correct, fast, and reliably auditable, you will ensure it stays that way as load grows and the platform expands into new environments. This standard is set everywhere in the system, not at a single layer: where governance decisions are computed and persisted, where correctness has to hold under concurrent load, and where early design choices either compound into leverage or into debt.

This role is for the engineer who owns the system. You will make the architectural decisions that shape how the platform evolves, and you will write the code that proves those decisions were right. The work rewards strong judgment about what to build, what to defer, and what to throw away. It demands the ability to hold a large system in your head and keep it coherent as it grows.

We are looking for someone whose strength is the fundamentals of software engineering, applied at the level of real systems. The engineer other engineers want next to them when something hard needs to be built correctly the first time.

What You Will Do
  • Design and build the core services, deciding how the system is decomposed, where state lives, and how components communicate

  • Work wherever the problem leads, from data model to product surface

  • Make deliberate tradeoffs across accuracy, consistency, availability, and latency

  • Define the internal APIs and abstractions that determine system trajectory 6+ months out

Who You Are
  • You have built non-trivial systems and can speak honestly about what aged well and what did not

  • You understand distributed systems tradeoffs well enough to make the right call for a given problem

  • You are comfortable on both sides of the stack and choose where to work based on the problem

  • You have strong opinions about software design and can defend them without being precious about them

Our Stack
  • Languages: Python, Rust, and Node/TypeScript, with React on the frontend

  • Data: Postgresql, vector, and graph databases

  • Infra: Docker, Kubernetes, Terraform, across several cloud providers and customer VPCs

  • ML: Self hosted models on multiple GPU providers and frontier APIs

What We Offer

Compensation & Equity: Competitive base compensation, plus significant equity in a venture-backed company with institutional investors including Google’s Gradient Ventures, General Catalyst, and Y Combinator. We want people who think and act like owners.

Real Impact: You will work directly on the core systems that determine how models perform in the wild. Your work ships into real, high-stakes environments where governance, auditability, and performance are non-negotiable.

Autonomy & Trust: We operate with a high degree of trust. You are expected to form strong technical opinions and execute on them.

Skills Required

  • Proven experience building non-trivial systems and making architectural decisions
  • Deep understanding of distributed systems tradeoffs (consistency, availability, latency)
  • Proficiency in Python
  • Proficiency in Rust
  • Proficiency in Node.js and TypeScript
  • Frontend experience with React
  • Experience with PostgreSQL
  • Experience with vector databases
  • Experience with graph databases
  • Experience with Docker and Kubernetes
  • Experience with Terraform and cloud infrastructure
  • Experience operating in customer VPCs and multi-cloud environments
  • Experience with self-hosted ML models, GPU providers, and/or frontier LLM APIs
  • Ability to define internal APIs and abstractions and own system trajectory
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
0 Employees
Year Founded: 2024

What We Do

CTGT is an applied AI research laboratory and deterministic governance layer designed to solve alignment and reliability bottlenecks for enterprise AI. By leveraging representation engineering and mechanistic interpretability, CTGT provides a model-agnostic platform that enables global institutions to deploy generative AI workflows with confidence, ensuring mathematical certainty and defensible audit trails required by the Fortune 500 to bridge the gap between LLM capabilities and domain-specific requirements.

Similar Jobs

Compa Logo Compa

Senior Software Engineer

Artificial Intelligence • HR Tech • Software • Business Intelligence
Hybrid
3 Locations
75 Employees
165K-220K Annually

MongoDB Logo MongoDB

Senior Software Engineer

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
2 Locations
5550 Employees
126K-248K Annually

General Motors Logo General Motors

Senior Software Engineer

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Hybrid
3 Locations
165000 Employees

MongoDB Logo MongoDB

Senior Software Engineer

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
United States
5550 Employees
147K-210K Annually

Similar Companies Hiring

Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
LTX Thumbnail
Conversational AI • Generative AI
Jerusalem, Israel
360 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account