AI Systems Engineer

Reposted 8 Days Ago
San Francisco, CA, USA
In-Office
350K-600K Annually
Mid level
Artificial Intelligence • Software
The Role
The AI Systems Engineer will design and develop a core ML stack, solve technical challenges across verticals, ensure code quality, and lead the team in building impactful AI systems.
Summary Generated by Built In
Salary range: $350,000 - $600,000/year + benefits

Description: Transluce is a fast-moving research lab building the public tech stack for understanding and debugging AI systems. We build world-class, AI-backed analysis tools and use these to set industry standards for evaluation. We are a non-profit with a mission to steer the development of AI for the public good.

About the role: We are looking for an exceptional AI systems engineer to lead the design and development of our core ML stack, building systems that can scale to thousands of GPUs and performantly query trillion-token databases.

As an early member of a highly collaborative team, you will be free to innovate and move fast, building high-impact systems from the ground up. As part of a mission-focused non-profit, your work will have high direct impact (e.g. used by governments to inform AI policy) and cross-organisational reach (open-source tools the entire community can build on).

Core responsibilities:
  • Set overall code culture and tooling for a fast-growing org
  • Help to solve our core technical challenges across verticals. Examples include:
    • Docent:
      • High-concurrency container-based evals with quick ability to iterate on interventions to agentic trajectories
      • Deterministic sandbox execution of code that can efficiently restore state from checkpoints
    • Interpretability:
      • Inference stacks that are as performant as vLLM but flexible enough to allow complex model introspection and intervention, steering, configurable sampling, etc., and that can scale to 400B+ parameter models
    • Behavior elicitation:
      • Distributed RL training and roll-outs allowing thousands of concurrent rollouts across machines
    • Build great internal tools to speed up the team
  • Help tone-set in the organization around best practices for building and path-set on what infra we should build
  • Help other team members think through infra challenges

Qualities of a strong candidate:
  • Exceptional programmer fluent in Python
  • Bare metal optimization: know GPUs, other accelerators in and out (low-level performance + optimization + parallel programming)
  • Experience engineering at scale (distributed systems, reliability, architecture design)
  • Leader on global code quality and health (designing good primitives, managing complexity and scale)
  • Bonus: can set up LLM pipelines, e.g. multiple specialized LLMs interacting with each other in a performant and reliable way
  • Bonus: experience with open-source community management

We are located in San Francisco and enthusiastic to work together in-person. We are open to sponsoring international visas.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
20 Employees
Year Founded: 2024

What We Do

Transluce is an independent research lab that builds open, scalable technology for understanding AI systems and steering them in the public interest. Transluce means to shine light through something to reveal its structure. Today’s complex AI systems are difficult to understand—not even experts can reliably predict their behavior once deployed. Given AI's extraordinary consequences on society, we need scalable and open analyses of the capabilities and risks of AI systems. We are building open source, AI-driven tools to understand and analyze AI systems. We will apply these tools to open-weight models, so the world can vet our analyses and improve their reliability. Once our technology has been vetted, we will work with frontier AI labs and governments to ensure that internal assessments reach the same standards as our publicly vetted procedures. Email: [email protected]

Similar Jobs

ServiceNow Logo ServiceNow

Senior Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Mountain View, CA, USA
28000 Employees

ServiceNow Logo ServiceNow

Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Mountain View, CA, USA
28000 Employees

ServiceNow Logo ServiceNow

Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Mountain View, CA, USA
28000 Employees

ServiceNow Logo ServiceNow

Machine Learning Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Mountain View, CA, USA
28000 Employees

Similar Companies Hiring

Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account