This role might be for you if you:
● Have proven success in creating comprehensive and maintainable automated tests for a fast-moving product
● Can design test strategies that blend automated regression coverage with targeted manual testing
● Have tested AI features in production and know how to validate retrieval quality and are familiar with hallucination risks and prompt sensitivity
● Have the experience and intuition to see around corners, identify quality risks, and implement preemptive solutions through automation
What you’ll do:
● Collaborate with product managers, actuaries, UX designers, and other engineers to design and implement automated UI tests, API tests, and performance monitoring tests to validate new features and detect regressions in existing features
● Own the QA automation lifecycle and continuously enhance the automation infrastructure
● Manage and monitor both automated and manual test execution to support continuous delivery
What you bring:
● Strong programming skills and hands-on experience writing automation code (JavaScript/TypeScript, Python, or similar)
● Proven experience using automation frameworks for UI testing, such as Playwright, Selenium, Cypress, or similar
● Experience using AI tools to accelerate QA work — generating test cases, writing automation code, and analyzing test failures
● Solid understanding of CI/CD pipelines, build and release tools such as GitHub Actions or Jenkins
● A critical eye for implementing shift left and value over volume QA philosophies
● Excellent communication, collaboration, problem-solving skills, and an analytical mindset
● Prior healthcare experience is a plus
● Startup experience is a plus
Tools we use:
● Claude, Cursor, Gemini
● Infrastructure: AWS, Databricks, PostgreSQL, Airflow
● Testing tools: Playwright, Datadog, GitHub Actions
● Version Control: GitHub
• Applicants must be legally authorized to work in the United States for the duration of their employment.
• This position is not eligible for employer-sponsored immigration sponsorship, now or in the future. • Applicants must be able to work in the United States without requiring employer sponsorship.
Skills Required
- 2-7 years of experience in QA automation
- Strong programming skills and hands-on experience writing automation code in JavaScript, TypeScript, Python, or a similar language
- Experience with UI automation frameworks such as Playwright, Selenium, Cypress, or similar
- Experience using AI tools to generate test cases, write automation code, and analyze test failures
- Solid understanding of CI/CD pipelines and build or release tools such as GitHub Actions or Jenkins
- Experience testing AI features in production, including retrieval quality, hallucination risks, and prompt sensitivity
- Ability to design automated regression strategies combined with targeted manual testing
- Excellent communication, collaboration, problem-solving, and analytical skills
- Prior healthcare experience
- Startup experience
What We Do
Arbital Health’s vision is to become the neutral 3rd party adjudicator of outcomes based contracts, unlocking and accelerating the $1 trillion shift to Value-Based Care in the U.S. healthcare system. We aspire to be the trusted umpire adjudicating every outcome-based contract in healthcare, whether contracts are between life sciences companies and payers, payers and providers, or employers and digital health companies. We will make it simple to adjudicate contracts and unlock the trillion dollar shift to value-based care in America. In doing so, we will help to solve healthcare’s biggest problem.









