Senior Applied ML Engineer, Evals & Data

Posted One Month Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Artificial Intelligence • Digital Media • Marketing Tech • Software
The Role
Own the quality measurement and improvement of an AI video-editing agent. Build evaluation datasets, offline and online evaluations, automated checks, human reviews, regression gates, and release criteria. Analyze agent failures and improve results through better data, evaluation methods, model selection, and fine-tuning. Partner with product and engineering to ship reliable improvements while tracking quality, latency, and cost.
Summary Generated by Built In
About
  • We're building the future of storytelling and video editing.

  • We're a small team that moves fast and builds things we're proud of.

  • We care obsessively about taste: in design, in product, in every detail.

  • We're solving these hard problems.

  • We're backed by a Tier-1 global fund, YC, and founders of billion dollar companies.

AI Engineering

Cardboard is a video editor you can talk to. Our agent makes real edits on the timeline. When it gets one right, it feels like magic. When it gets one wrong, it costs someone their afternoon.

We're hiring a Senior Applied ML Engineer to own how good the agent is: turn real failures into evals, evals into a bar the team trusts, and that bar into shipped improvements. This isn't research-only, prompt-only, or QA.

What you'll own
  • What "good" means for our agent, and datasets built from real usage.

  • Offline and online evals: automated checks, model graders, and human review.

  • Regression gates, and quality tracked alongside latency and cost.

  • Which models the agent runs on.

Who you are
  • You've shipped an LLM or agent system that real customers used.

  • You've built evals, datasets, or AI quality systems before.

  • You can turn "the agent feels dumb" into a number, then move it.

  • Strong in TypeScript or Python. No PhD needed.

  • Bonus: multimodal AI, video, or fine-tuning.

How we work
  • You own outcomes, not tickets: decide what to build, ship it, and check it worked.

  • You talk to users and look at the data.

  • You build with AI agents every day, and you're the taste and judgment in the loop.

What success looks like

Within your first six months:

  • The team trusts a quality baseline for our main agent workflows.

  • Production failures regularly become eval cases.

  • We can show measurable improvements in key editing workflows.

What you get

You'd be surrounded by people who are absurdly good at what they do. One started coding at 11 and shipped an app with 6M+ downloads in high school. One got into CS engineering at 14 and has been working on distributed systems for 8+ years. One's an ex-founder who took a company to 1.2M users and $300M+ in transactions. That's the team. We're looking for someone who'll raise the bar on how we measure and improve AI quality. Apart from that you'd get:

  • Competitive salary and founding-team equity.

  • Unlimited tokens across every AI model. Use whatever you want, as much as you want.

  • A healthy budget for AI tools and any peripherals you need to do your best work.

Skills Required

  • Experience shipping and operating an LLM or agent system used by real customers
  • Strong software engineering skills in TypeScript or Python, with the ability to work across both
  • Experience building evaluations, datasets, experiments, or AI quality systems
  • Strong product judgment and ability to turn unclear quality problems into measurable improvements
  • Experience with multimodal AI, video, media, or creative software
  • Experience with human labeling, model graders, or fine-tuning
  • Knowledge of experiment design and statistics
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
5 Employees
Year Founded: 2025

What We Do

Cardboard, Inc. develops an agentic, browser-based AI video editor for growth and marketing teams and serious creators. Users can describe an intended edit in natural language, while the product cuts, captions, reframes, composes, and searches footage. Its browser-native workflow combines a multi-layer timeline, collaboration, auto-captioning, voiceover and music generation, and exports for professional finishing applications, helping teams produce and iterate videos faster.

Similar Jobs

ServiceNow Logo ServiceNow

Architect

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
29000 Employees

Cloudflare Logo Cloudflare

Security Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
4400 Employees

ServiceNow Logo ServiceNow

Senior Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Bangalore, Bengaluru, Karnataka, IND
29000 Employees

ServiceNow Logo ServiceNow

Customer Success Executive

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
29000 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account