Founding Engineer (AI)

Posted Yesterday
San Francisco, CA, USA
In-Office
150K-220K Annually
Mid level
Information Technology • Software • Automation
Software Development
The Role
Build and own core parts of an AI-native automated testing platform. Integrate and tune LLMs for production, implement LLM evaluation and observability, perform SFT/RLFT, engineer evaluation datasets and prompts, and ship full-stack features using Python/TypeScript in an in-person San Francisco team.
Summary Generated by Built In

At Momentic, we’re building the future of quality.

We’re building the all-in-one quality platform powered by state of the art agents to help our customers ensure quality at every stage of the SDLC.

Top engineering teams at companies like Notion, Retool and Webflow use Momentic to ship high quality product. Millions of Momentic tests are executed every single day.

Our product has a very large problem space so there’s a ton of stuff to build and take ownership of - we’d be excited to get your help as we're hiring several extremely talented software engineers across the stack.

The product

  • The AI-native automated testing platform

  • Incredibly sticky. Our customers run us on every pull request and merge and before each deploy as quality gates

  • Leagues ahead of the status quo today (think Selenium/Cypress/Playwright)

  • Check out the demo video on our website.

About us

  • We’re a lean team of 17 (ex Robinhood, Retool, WeWork, Qualtrics, Assembled)

  • Located in-person San Francisco (650 5th St.)

  • Recent Series A raise of $15M led by Standard Capital, with participation from existing investors - Y Combinator, FCVC, and Transpose Platform.

You’re perfect for this role if…

  • You enjoy solving hard problems that have both product and technical ambiguity

  • You have strong engineering fundamentals, code efficiently, and you know what you're great at and what you're less great at

  • You dislike meetings and would much rather focus your time on building, being productive, and shipping code

  • You thrive when you have autonomy, own as many of the details as possible, and project manage your own work

  • You're in SF or you're willing to relocate, you love working in-person, and you're serious about joining us to build a culture we'll all love

Must-have qualifications

  • Experience with LLM performance tuning, including prompt engineering and context management strategies

  • Experience with LLM evaluations and observability

  • Experience integrating LLMs into real-world applications using a modern tech stack (Python, TypeScript, etc.)

  • Familiarity and experience with supervised fine-tuning (SFT) and/or reinforcement learning fine tuning (RLFT) on platforms such as fireworks, Together AI, or Baseten

  • Familiarity with evaluation dataset engineering, prompt engineering, LLM as a judge verifiers, and RL environments

  • 3+ years of experience

Nice to have

  • Experience with supervised or reinforced fine-tuning

  • Experience with classical machine learning techniques such as template matching, bounding box detection, and OCR

  • Experience running statistical experiments


Our stack

React, TypeScript, Next.js, Node.js, PostgreSQL, Google Cloud, Kubernetes

Benefits

  • Competitive Medical, Vision, Dental insurance

  • 401K

  • Unlimited PTO

  • Offsites and events (French Laundry last quarter)

  • Fully stocked kitchen (Unlimited supply of sparkling water!)

Sponsorship

We can sponsor TN, E-3, or J-1 Visas. We can't sponsor/transfer H1B Visas or Green Cards (I-140) at this time.

Skills Required

  • Experience with LLM performance tuning including prompt engineering and context management strategies
  • Experience with LLM evaluations and observability
  • Experience integrating LLMs into real-world applications using a modern tech stack (Python, TypeScript, etc.)
  • Familiarity and experience with supervised fine-tuning (SFT) and/or reinforcement learning fine tuning (RLFT) on platforms such as Fireworks, Together AI, or Baseten
  • Familiarity with evaluation dataset engineering, prompt engineering, LLM-as-judge/verifiers, and RL environments
  • 3+ years of experience
  • Willingness to work in-person in San Francisco or relocate
  • Experience with supervised or reinforced fine-tuning
  • Experience with classical machine learning techniques such as template matching, bounding box detection, and OCR
  • Experience running statistical experiments
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Milwaukee, WI
40 Employees
Year Founded: 2023

What We Do

Momentic is the modern standard for software testing. Streamline regression testing, production monitoring, and UI automation.

Why Work With Us

Momentic is the modern standard for software testing. Streamline regression testing, production monitoring, and UI automation.

Similar Jobs

ETH juniors Logo ETH juniors

Artificial Intelligence Engineer

Professional Services • Consulting
In-Office
San Francisco, CA, USA
45 Employees

kos.ai Logo kos.ai

Artificial Intelligence Engineer

Artificial Intelligence • Software • Financial Services • Automation
Hybrid
San Francisco, CA, USA
30 Employees
170K-250K Annually

SignalFire Logo SignalFire

Artificial Intelligence Engineer

Angel or VC Firm • Artificial Intelligence • Information Technology • Software
In-Office or Remote
7 Locations
97 Employees
170K-250K Annually

Match Group Logo Match Group

Full-stack Engineer

Mobile • Social Media
Hybrid
Los Angeles, CA, USA
1400 Employees
300K-325K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account