Patronus AI is building hyperrealistic, diverse reinforcement learning (RL) environments and benchmarks to steer frontier AI models. Our mission is to enable next generation AGI capabilities through scalable oversight.
We are a team of AI researchers and engineers formerly from companies like Meta AI, Amazon AGI, and Google. As a team, we have published research papers at top ML conferences (NeurIPS, EMNLP, ACL), and we are the creators of popular AI products and benchmarks like FinanceBench, SimpleSafetyTests, CopyrightCatcher, Humanity’s Last Exam, and more. Our customers include foundation model labs and Fortune 500 enterprises like The Volkswagen Group. We are backed by top-tier investors like Notable Capital, Lightspeed Venture Partners, Stanford University, and leading researchers at OpenAI, Databricks, and more.
As a Forward Deployed Software Engineer at Patronus AI, you will work closely with customers to learn about their problems and implement specific solutions and guide them through their AI journey.
In this role, you will:
- Apply creativity, analytical ability, and technical skills to solve key AI problems for customers
- Set up and walk through custom product demos to showcase platform capabilities to prospective customers
- Create example scripts, develop custom evaluation datasets, build custom web apps, and write technical docs to educate customers on how to use the platform
- Guide customers on best practices for LLM evaluation and advise them on AI strategy
- Write technical blog posts and evangelize the product and company on social media and at community events
- Collaborate with cross-functional partners in sales, product, engineering, ML to drive roadmap direction and hit key commercial milestones
"The number one qualification to succeed in this machine learning course is gumption” - John Lafferty, CS Professor at Yale
Above all, we look for a proactive mindset, willingness to learn, relentless drive, and passion for working hands-on with customers. You are a great fit if you have a background in the following:
- BS/MS in Computer Science, Mathematics, Statistics, or other quantitative field
- Strong engineering background, preferably in machine learning or data science
- Experience with programming languages like Python, Java, C++, or similar
- Experience with cloud environments like AWS
- Excellent communication and analytical problem-solving skills
- Willingness to travel to customers if needed
- Have good character, integrity, and respect for others!
- Competitive salary and equity packages
- Health, dental, and vision insurance plans
- 401(k) plan
- Monthly meal stipend
- Monthly health and wellness stipend
- Fun global offsites!
Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.
Similar Jobs
.jpg)
What We Do
Patronus AI is the leading AI evaluation and optimization company. Our research-backed product enables AI engineers to optimize their agents, access powerful evaluation models, and automatically detect LLM system performance issues across 50+ modes. Leading technology companies and enterprises like AngelList, Etsy, and Pearson use Patronus AI to ship top-tier AI products. Founded by machine learning experts from Meta, Patronus AI is on a mission to accelerate the world's adoption of generative AI. We are backed by Notable Capital, Lightspeed Venture Partners, Stanford University, Datadog, Gokul Rajaram, and leading software and AI executives.
