- Researching techniques for building realistic simulations or reproductions of AI deployment environments.
- Developing high quality public evaluations to raise the bar for evaluation work across the independent oversight ecosystem.
- Informing and contributing to the development of tools for automating parts of the evaluation process.
- Shaping Transluce’s approach to evaluations and investigating fundamental questions in evaluation science.
- Hands-on experience designing and running AI evaluations, particularly behavioral or interactive evaluations (multi-turn, agentic, or red-teaming contexts).
- Research track record that includes careful empirical or methods work, ideally in evaluation science.
- Experience working in cross functional teams of researchers, engineers, and domain experts.
- Strong communication skills, low ego, openness to giving and receiving feedback.
- Engineering skills: implementing well-designed software, user testing, and iterating on feedback.
- Past work on building agent harnesses or LLM-powered automated research systems.
Skills Required
- Experience designing and running AI evaluations, especially behavioral or interactive evaluations
- Strong engineering instincts and judgment for deliverables
- Experience in customer-facing, consulting, or forward-deployed roles
- Experience running evaluations at scale or in a production context
- Ability to balance needs of researchers and domain experts
- Strong communication skills and openness to feedback
What We Do
Transluce is an independent research lab that builds open, scalable technology for understanding AI systems and steering them in the public interest. Transluce means to shine light through something to reveal its structure. Today’s complex AI systems are difficult to understand—not even experts can reliably predict their behavior once deployed. Given AI's extraordinary consequences on society, we need scalable and open analyses of the capabilities and risks of AI systems. We are building open source, AI-driven tools to understand and analyze AI systems. We will apply these tools to open-weight models, so the world can vet our analyses and improve their reliability. Once our technology has been vetted, we will work with frontier AI labs and governments to ensure that internal assessments reach the same standards as our publicly vetted procedures. Email: [email protected]


.png)






