Machine Learning Scientist

Transform healthcare with us.

At Qualified Health, we’re redefining what’s possible with Generative AI in healthcare. Our infrastructure provides the guardrails for safe AI governance, healthcare-specific agent creation, and real-time algorithm monitoring—working alongside leading health systems to drive real change.

This is more than just a job. It’s an opportunity to build the future of AI in healthcare, solve complex challenges, and make a lasting impact on patient care. If you’re ambitious, innovative, and ready to move fast, we’d love to have you on board.

Join us in shaping the future of healthcare.

Job Summary:

We're looking for an ML Scientist to join our AI team to join in developing the scientific foundations for our healthcare AI platform. As a scientist at Qualified Health, you’ll be at the cutting edge of applied research on evaluating and improving generative AI applied in a healthcare setting, while also working closely with doctors and other healthcare professionals to ensure the system meets their needs.

In this role, you will develop methodologies to understand and measure the capabilities, limitations, and safety properties of agentic workflows and other generative AI system components. You'll design and implement evaluation frameworks that rigorously assess how well our systems perform a wide variety of healthcare-oriented tasks. And you will use these measures and frameworks to improve the performance of our system.

Key Responsibilities:

• Design and implement evaluation methodologies to measure the reliability, safety, and effectiveness of our AI platform
• Develop novel benchmarks and metrics that capture the nuanced requirements of our adaptive care platform
• Conduct empirical research on the capabilities and limitations of agentic AI workflows in healthcare settings
• Collaborate with our care teams to ensure evaluations are clinically relevant and aligned with patient needs
• Build monitoring systems to detect potential failures or risks in AI-assisted care workflows
• Contribute to the scientific literature on AI evaluation in healthcare through publications and conference presentations
• Work closely with our engineering and product teams to integrate evaluation insights into system development
• Help establish best practices for the safe deployment of agentic systems within our full-stack healthcare system

Required Qualifications:

• PhD or equivalent research experience in machine learning, AI, computer science, or a related field
• Expert-level background in machine learning research, particularly in areas related to language models, reinforcement learning, or AI alignment
• Excellent programming skills, preferably in Python
• Track record of high-quality research publications in venues like NeurIPS, ICML, ACL, ICLR, or similar
• Interest in and enthusiasm for the responsible development of AI technology in healthcare

Desirable Skills:

• Experience working with large language models or foundation models
• Experience designing and implementing evaluation methodologies for complex AI systems
• Background in healthcare informatics, clinical decision support systems, or medical AI
• Prior work on generative AI robustness and evaluation

Why Join Qualified Health?

This is an opportunity to join a fast-growing company and a world-class team, that is poised to change the healthcare industry. We are a passionate, mission-driven team that is building a category-defining product. We are backed by premier investors and are looking for founding team members who are excited to do the best work of their careers.

Our employees are integral to achieving our goals so we are proud to offer competitive salaries with equity packages, robust medical/dental/vision insurance, flexible working hours, hybrid work options and an inclusive environment that fosters creativity and innovation.

Our Commitment to Diversity

Qualified Health is an equal opportunity employer. We believe that a diverse and inclusive workplace is essential to our success, and we are committed to building a team that reflects the world we live in. We encourage applications from all qualified individuals, regardless of race, color, religion, gender, sexual orientation, gender identity or expression, age, national origin, marital status, disability, or veteran status.

Pay & Benefits: The pay range for this role is between $200,000 and $300,000, and will depend on your skills, qualifications, experience, and location. This role is also eligible for equity and benefits.