Research Engineer, Safety & Alignment

Posted 4 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
Entry level
Artificial Intelligence • Software
The Role
Conduct AI safety and alignment research for autonomous software agents. Build release-gating evaluations, red-team models and agent harnesses, develop alignment methods, and improve permissions, oversight, escalation, and model behavior. The role combines empirical research engineering with production agent development, requiring collaboration across safety, post-training, and agent teams, plus contributions to external safety research.
Summary Generated by Built In
We are an applied AI lab building end-to-end software agents.

We're the makers of Devin, the first AI software engineer.

Our team is extremely talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro.

Building Devin is just the first step—our hardest challenges still lie ahead. If you’re excited to solve some of the world’s biggest problems and build AI that can reason on real-world tasks, apply to join us.

Role Mission

Devin writes and runs code, uses tools, takes actions in real customer systems, and operates for hours without a human in the loop. Safety here is not a research paper; it is whether an agent behaves correctly in production, millions of times a day. You will be a founding member of Cognition's safety team, reporting to the Head of Safety. You will build the evaluations and red-teaming that gate every release, develop alignment methods that shape how our models are trained, and work directly with the agent team on how Devin plans, acts, and asks for help. This is a hands-on research engineering role for someone who wants their safety work to run in the loop of a real agent, not sit in a benchmark.

What You'll Accomplish
  • Build agentic safety evals: Design and run evaluations for the failure modes that matter for autonomous agents: unsafe actions, prompt injection, data exfiltration, sandbox escape, reward hacking, and misuse. Make them fast enough to run on every model and product release.

  • Red-team Devin: Attack the agent and its harness systematically. Find the failures before customers do and turn them into fixes and regression tests.

  • Develop alignment methods: Work with post-training on reward modeling, preference data, constitutional approaches, and other techniques that make the model safer without making it worse at the job.

  • Shape the agent harness: Partner with the agent team on permissions, oversight, and escalation: when Devin should act, when it should ask, and how it should explain itself.

  • Publish and share: Contribute to Cognition's external safety work through papers, evals, and open methods where it makes sense.

Exceptional Candidates Have Demonstrated
  • Safety or alignment research experience: Hands-on work on evaluations, red-teaming, alignment, or interpretability at a frontier AI lab or in published research. You have built things that changed how a model was trained or deployed.

  • Agentic systems understanding: You know how agents fail in practice: tool misuse, specification gaming, long-horizon drift, adversarial inputs. You have measured it or have concrete ideas about how to.

  • Strong engineering fundamentals: Proficiency in Python and PyTorch (or JAX). You can build eval infrastructure, run experiments at scale, and read the training and inference code.

  • Empirical rigor: You design clean experiments, report results honestly, and know the difference between a real improvement and noise.

  • Comfort with adversarial thinking: You enjoy breaking systems and are good at it.

  • Relevant industry experience: Prior experience at a frontier AI lab, applied AI company, or developer tools company.

  • Advanced degree: PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline; or equivalent industry research experience.

Our Commitment

Equal Opportunity. Cognition is an equal opportunity employer. We do not discriminate on the basis of any protected characteristic under applicable law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the hiring process - please let us know if you need any. Cognition also considers applicants with criminal histories consistent with the SF Fair Chance Ordinance and similar local laws.

Data Privacy and Arbitration: By submitting your application, you agree to our Global Applicant and Job Candidate Privacy Notice. For US applicants, by submitting your application, you agree to the Applicant Arbitration Agreement.

Skills Required

  • Hands-on safety or alignment research experience involving evaluations, red-teaming, alignment, or interpretability
  • Understanding of agentic system failure modes, including tool misuse, specification gaming, long-horizon drift, and adversarial inputs
  • Proficiency in Python and PyTorch or JAX
  • Ability to build evaluation infrastructure, run experiments at scale, and read training and inference code
  • Ability to design rigorous experiments and distinguish meaningful improvements from noise
  • Comfort with adversarial thinking and systematically breaking systems
  • Prior experience at a frontier AI lab, applied AI company, or developer tools company
  • PhD in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline, or equivalent industry research experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
49 Employees

What We Do

Makers of Devin, the first AI software engineer. We are an applied AI lab building end-to-end software agents. We’re building collaborative AI teammates that enable engineers to focus on more interesting problems and empower engineering teams to strive for more ambitious goals.

Similar Jobs

OpenAI Logo OpenAI

Scientist

Artificial Intelligence • Machine Learning • Generative AI
In-Office
San Francisco, CA, USA
4500 Employees

Character.AI Logo Character.AI

Research Engineer, AI Safety & Alignment

Artificial Intelligence • Software • Conversational AI • Generative AI
In-Office
Redwood City, CA, USA
30 Employees
225K-400K Annually

Narmi Logo Narmi

Director Of Sales

Enterprise Web • Fintech • Payments • Software • Financial Services
Remote or Hybrid
United States
140 Employees
150K-170K Annually

Narmi Logo Narmi

Growth Executive

Enterprise Web • Fintech • Payments • Software • Financial Services
Remote or Hybrid
USA
140 Employees
125K-150K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account