Senior AI Product Engineer

Posted 2 Hours Ago
Easy Apply
Be an Early Applicant
New York, NY, USA
Hybrid
182K-220K Annually
Senior level
Healthtech • Pharmaceutical • Telehealth
Ro's mission is to help patients achieve their health goals by delivering the easiest, most effective care possible.
The Role
Embed with clinical and operations teams to identify high-value AI opportunities; build LLM-powered features end-to-end including prompts, orchestration, Python services, evaluation suites, golden datasets, and metrics-driven experiments to measure product impact and prioritize work.
Summary Generated by Built In

Join Tech @ Ro to build the future of healthcare, from the ground up!

At Ro, we believe that when people achieve their health goals, they can achieve their life goals. The highest-leverage way to move society forward is to give people their health, and the current healthcare system isn’t built to do that. It was built to bill, not to serve patients.

We’re building a new system. One where the patient is in control. One designed from scratch for the digital age.

At Ro, technology isn’t just a function… It's core to how we deliver care. We’ve built a vertically integrated healthcare platform that connects telehealth, diagnostics, pharmacy, and logistics into a seamless, end-to-end experience for millions of patients.

…and we’re just getting started. 

As part of Tech @ Ro, you’ll work on systems that operate at scale, with an opportunity to:

  • Solve complex, high-concurrency problems across a full-stack platform
  • Build and ship quickly with tight feedback loops and real-world impact
  • Own systems end-to-end, from architecture to production performance
  • Work alongside experienced operators, technical leaders, and clinicians
  • Help define how modern healthcare should be delivered

We’re a performance-driven team with a strong sense of ownership and urgency. We move fast, learn quickly, and hold a high bar for what we build, and do so with a big heart — because patients depend on it.

If you’re motivated by impact, scale, and the chance to help lead the patient revolution, come build with us.


The Role
Ro is building a team focused on shipping LLM-powered products across the patient experience, clinical operations, and internal tooling.

We're hiring a Senior AI Product Engineer to join a new team we're building from the ground up. This is a hybrid Product + Engineering role for someone who wants to own the full lifecycle of AI products: from identifying high-value problems to building, shipping, and measuring solutions.

You'll embed with clinical operations, pharmacy, and care teams to understand how work gets done, identify the highest-leverage opportunities for AI, and build the systems yourself. You'll write prompts, orchestration code, evaluations, and Python services, partnering closely with engineers while remaining hands-on in implementation.

You'll own a portfolio of opportunities and help decide what to build, what to buy, and what to tackle next.

What You'll Do

  • Embed directly with operators and clinical teams to dissect manual workflows and rebuild them with LLMs and agentic patterns.
  • Drive build-vs-buy strategy: when to build custom orchestration, when to integrate a third-party tool.
  • Write prompts, evaluation suites, and Python code that connect AI systems to Ro's products and internal operations.
  • Create golden datasets, define evaluation rubrics, and run experiments that continuously improve quality and reliability.
  • Define success metrics, measure product impact, and use data to prioritize future investments.
  • Shape prioritization, sequencing, and technical direction across the AI pod.

Who You Are

  • 5+ years of experience spanning product management, software engineering, applied AI, technical program management, or a combination of these disciplines.
  • You can write Python and call an API; you don't need to architect a backend, but you're not bottlenecked waiting for someone who can.
  • You've shipped at least one AI powered feature you can talk about in detail,  including the metrics that justified it.
  • You have strong product judgment and are comfortable operating with ambiguity, identifying opportunities through direct observation rather than waiting for detailed requirements.
  • You’re excited about using AI tools to build software
  • You enjoy working directly with users and operators, rapidly testing ideas, and iterating based on real-world feedback.
  • Bonus: clinical, healthcare, or other regulated-industry experience.

A note on reporting structure

This is a new function at Ro, and we're being deliberate about not over-defining it. Your manager and where you sit on the org chart will depend on the specific shape of the team we end up with. We'd rather find the right people and figure out the lines around them than pre-draw boxes and miss great candidates. If that ambiguity is a deal-breaker, this isn't the right role; if it sounds like an opportunity, we want to talk.

-
 
The target base salary for this position ranges from $182,300 to $220,000, in addition to a competitive equity and benefits package (as applicable). When determining compensation, we analyze and carefully consider several factors, including location, job-related knowledge, skills and experience. These considerations may cause your compensation to vary.

Ro is consistently recognized as a top workplace in Health Care, in New York, and for Women and Parents—earning more than 20 honors from Fortune, Great Place to Work, and PEOPLE since 2021. In 2025 alone, we ranked top 5 among medium workplaces in Health Care and New York, and top 50 nationwide.
 
At Ro, we believe that our diverse perspectives are our biggest strengths — and that embracing them will create real change in healthcare. As an equal opportunity employer, we provide equal opportunity in all aspects of employment, including recruiting, hiring, compensation, training and promotion, termination, and any other terms and conditions of employment without regard to race, ethnicity, color, religion, sex, sexual orientation, gender identity, gender expression, familial status, age, disability and/or any other legally protected classification protected by federal, state, or local law.
 
Ro is committed to providing reasonable accommodations for qualified individuals with disabilities in our application and interview process. If you require a reasonable accommodation in the application or interview process, please contact us at [email protected].
 
See our California Privacy Policy here.

Skills Required

  • 5+ years of experience spanning product management, software engineering, applied AI, technical program management, or combination
  • Ability to write Python and call APIs
  • Has shipped at least one AI-powered feature and can discuss metrics that justified it
  • Experience with prompt engineering, LLM orchestration, and evaluation suites
  • Experience creating golden datasets, defining evaluation rubrics, and running experiments to improve model quality
  • Strong product judgment and comfort operating with ambiguity; experience working directly with users/operators to iterate quickly
  • Clinical, healthcare, or regulated-industry experience

What the Team is Saying

Kim
Rachel
Andres
Ross
Kerry
Jay
Zach
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
824 Employees
Year Founded: 2017

What We Do

Ro is a direct-to-patient healthcare company with a mission of helping patients achieve their health goals by delivering the easiest, most effective care possible. Ro is the only company to offer nationwide telehealth, labs, and pharmacy services. This is enabled by Ro's vertically integrated platform that helps patients achieve their goals through a convenient, end-to-end healthcare experience spanning from diagnosis, to delivery of medication, to ongoing care. Since 2017, Ro has helped millions of patients in nearly every single county in the United States, including 98% of primary care deserts.

Why Work With Us

Ro is powering quality care at scale. The Ro Operating System (ro.OS) vertically integrates the core parts of healthcare, bringing together nationwide telehealth, lab, and pharmacy services on one platform. The result? ro.OS makes it easier for patients to access and providers to deliver high-quality care – millions of times over.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Ro (Ro.co) Teams

Team
Technology
Team
Clinical
Team
Pharmacy
About our Teams

Ro (Ro.co) Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Ro’ers in the tri-state area join their colleagues in the NY Hub twice a week for in-person collaboration.

Typical time on-site: 2 days a week
HQRo HQ
US
Learn more

Similar Jobs

Ro (Ro.co) Logo Ro (Ro.co)

Scientist

Healthtech • Pharmaceutical • Telehealth
Easy Apply
Hybrid
New York, NY, USA
824 Employees
182K-220K Annually

Ro (Ro.co) Logo Ro (Ro.co)

Data Scientist

Healthtech • Pharmaceutical • Telehealth
Easy Apply
Hybrid
New York, NY, USA
824 Employees
150K-184K Annually

Ro (Ro.co) Logo Ro (Ro.co)

Product Engineer

Healthtech • Pharmaceutical • Telehealth
Easy Apply
Hybrid
New York, NY, USA
824 Employees
150K-184K Annually

Ro (Ro.co) Logo Ro (Ro.co)

Artificial Intelligence Engineer

Healthtech • Pharmaceutical • Telehealth
Easy Apply
Hybrid
New York, NY, USA
824 Employees
150K-184K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account