Applied Scientist, Experimentation

Reposted One Month Ago
7 Locations
In-Office or Remote
180K-300K Annually
Mid level
Information Technology • Internet of Things
The Role
The Applied Scientist will transform raw data into actionable insights by developing machine learning models for personalization, ranking, and optimization to enhance conversion and revenue. This role emphasizes building production systems, frameworks for experimentation, and communication with team members regarding technical challenges.
Summary Generated by Built In
About Coframe

At Coframe, we are building a future where user and agent interfaces can adapt, evolve, and personalize themselves. We are generating revenue, growing rapidly, and trusted by companies you definitely know.

Coframe is a primarily in-person company based in San Francisco, well-capitalized with backing from Khosla Ventures, Nat Friedman, the founder of Android, and others. Our team is small and talent-dense, consisting of competitive programmers, former founders (including our founder who previously co-founded a unicorn), and AI researchers from top institutions who have created some of the most popular open-source code generation projects.

About the role:

As an Applied Scientist focused on experimentation, you’ll build the intelligence that determines what to test, how to measure impact, and which experiences to ship. You’ll develop an opinionated yet flexible experimentation and analytics platform that powers decision-making across every Coframe product line.

Your work will help Coframe extract reliable signals from noisy behavioral data, measure long-term business impact, and continuously optimize customer outcomes with less human intervention.

You’re a great fit if you have:
  • A strong background in statistics, causal inference, machine learning, experimentation, or a related quantitative field

  • Experience designing, building, or significantly evolving large-scale online experimentation platforms

  • Deep knowledge of experimentation design, statistical methodology, and common measurement pitfalls

  • Experience with Bayesian methods, reinforcement learning, contextual multi-armed bandits, or online decision systems

  • Experience modeling delayed outcomes, long-term value, proxy metrics, and incremental lift

  • Strong software engineering fundamentals and experience building reliable production systems

  • The ability to translate product and business problems into rigorous statistical and machine learning approaches

  • Strong product judgment and the ability to connect technical models with customer needs and mental models

  • Experience building personalization, ranking, recommendation, optimization, or allocation systems

  • The ability to communicate complex technical concepts clearly to technical and non-technical stakeholders

  • A pragmatic approach to applied research and a focus on solving real customer problems rather than optimizing in isolation

  • A track record of staying current with developments in experimentation, causal inference, and decision science

What you’ll do:
  • Build experimentation frameworks that power every product line across Coframe

  • Develop statistical models for measuring incremental lift, confidence, and long-term business impact

  • Create decision engines that automatically start, stop, ramp, and optimize experiments

  • Design systems that balance exploration and exploitation throughout the experiment lifecycle

  • Build personalization and optimization algorithms that maximize conversion, engagement, revenue, and other customer outcomes

  • Develop simulation and evaluation frameworks for experimentation and online decision systems

  • Build analytics pipelines that transform large-scale behavioral data into actionable insights

  • Develop causal inference and measurement frameworks for noisy, delayed, and incomplete feedback

  • Model long-term value, proxy metrics, and delayed rewards

  • Identify opportunities for automated performance gains across customer programs

  • Analyze existing systems and translate findings into measurable product improvements

  • Build a unified optimization system that operates across multiple Coframe product lines

  • Work closely with engineering, product, and customer-facing teams to ensure statistical methods reflect real-world requirements

Benefits:
  • Flexible (Unlimited) Paid Time Off

  • Medical, Dental, and Vision benefits for you and your family

  • Life Insurance and Disability Benefits

  • 401k Plan with Coframe match

  • Meals covered in-office

  • Gym membership

“You guys are insane.” - OpenAI team

“Coframe makes you feel like you have a team of 100 people.” - Replit team

Coframe is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other characteristic protected by applicable federal, state, or local law.

Skills Required

  • Built production machine learning systems end to end
  • Strong statistics fundamentals and practical judgment with real-world data
  • Experience with ranking, optimization, personalization, bandits, or recommendation systems
  • Great communication skills to explain complex technical problems
  • Worked in growth or conversion teams before
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
20 Employees

What We Do

One day, we’ll look at the digital interfaces we use today the same way we now look at floppy disks and dial-up internet. Coframe is pioneering this next generation of user interfaces that can adapt, evolve, and improve themselves: living interfaces. Coframe is solving fundamental problems in AI and product, training multimodal models that understand users and business goals to enable user interfaces to continuously and autonomously improve themselves. We're hiring! If you get excited about shipping breakthroughs years ahead of schedule, please apply at https://coframe.com/careers

Similar Jobs

Block Logo Block

Director, Revenue Strategy & Planning

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
218K-327K Annually

Block Logo Block

Ios Engineer

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
264K-395K Annually

Affirm Logo Affirm

Senior Software Engineer

Big Data • Fintech • Mobile • Payments • Financial Services
Easy Apply
Remote
Canada
2200 Employees
153K-213K Annually

HiBob Logo HiBob

Enterprise Account Executive

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
Canada
1350 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account