Your Future Evolves Here
Evolent partners with health plans and providers to achieve better outcomes for people with most complex and costly health conditions. Working across specialties and primary care, we seek to connect the pieces of fragmented health care system and ensure people get the same level of care and compassion we would want for our loved ones.
Evolent employees enjoy work/life balance, the flexibility to suit their work to their lives, and autonomy they need to get things done. We believe that people do their best work when they're supported to live their best lives, and when they feel welcome to bring their whole selves to work. That's one reason why diversity and inclusion are core to our business.
Join Evolent for the mission. Stay for the culture.
What You’ll Be Doing:
Position Summary
The Senior QA Automation Engineer leads the quality strategy for the Evolent Platform web user experience. This role designs and maintains end-to-end, component, accessibility, contract, and test automation for a React and Next.js application and owns the quality signals that determine release readiness.
This individual works independently with minimal supervision, applies creativity to testing challenges, sets and upholds the automation patterns others follow, and mentors quality engineers across the team. The role is expected to use approved AI-assisted tools to accelerate testing and improve quality while remaining fully accountable for every delivered result.
AI-Assisted Engineering Expectations
Evolent engineers are expected to effectively leverage approved AI-assisted development and productivity tools (e.g., code assistants, copilots, automation agents, knowledge assistants, and analytics tools) to improve quality, efficiency, and innovation while maintaining accountability for all delivered work. These expectations span the full engineering lifecycle, not only code generation, including iterating with AI on test strategy and solution design, evaluating alternatives, and producing design artifacts. Engineers remain responsible for validating outputs, ensuring solution quality, protecting sensitive information, and complying with security, privacy, regulatory, and Responsible AI standards.
Key Responsibilities
Quality Strategy and Leadership
• Develop, implement, and manage comprehensive test strategies for the user experience, covering functional, regression, accessibility, performance, and AI-output quality.
• Participate in code reviews, design discussions, and product planning to ensure quality is built into all phases of the software lifecycle.
• Define and uphold test automation patterns and standards in partnership with testing automation architects and front-end leads.
• Mentor quality engineers, promoting best practices in testing, automation, and quality assurance.
• Drive continuous improvement initiatives in testing processes, tools, and methodologies, and evaluate emerging testing technologies for applicability.
Test Automation and CI/CD
• Lead the creation, maintenance, and optimization of Playwright end-to-end suites and Vitest component tests for React and Next.js features.
• Build contract tests for the AG-UI event stream, verifying event sequencing, shared state, tool-call events, and human-in-the-loop approval interrupts.
• Build API tests for backend-for-frontend endpoints and .NET and Python (FastAPI) services.
• Test streaming behavior and resilience, including slow, interrupted, and failed agent calls, retries, and timeouts.
• Plan and execute basic load and performance tests for streaming endpoints and data-heavy screens.
• Integrate and execute automated suites in GitHub Actions, maintaining a consistently high pass rate and reliable results.
Accessibility Testing
• Lead accessibility testing against WCAG 2.1/2.2 AA and Section 508, combining automated axe-core checks with manual screen reader testing using JAWS, NVDA, and VoiceOver.
• Partner with engineering and design to triage accessibility defects and support independent accessibility conformance reviews.
Defect Management and Quality Reporting
• Isolate, analyze, document, and prioritize defects before escalating to developers, and collaborate with developers, business analysts, and stakeholders for timely resolution.
• Analyze test and evaluation results, generate quality metrics, and report on quality state and release readiness to stakeholders.
• Present work in Agile ceremonies and lead technical knowledge-sharing sessions.
AI-Enabled Quality Engineering
• Utilize approved AI-assisted engineering tools to accelerate test design, test script development, test data generation, documentation, troubleshooting, and defect analysis.
• Evaluate and validate AI-generated tests, scripts, and analysis for correctness, security, maintainability, compliance, and business appropriateness.
• Continuously identify opportunities to improve testing productivity and solution quality through AI-enabled workflows and automation.
• Contribute reusable prompts, skills, agents, testing playbooks, and AI-assisted testing patterns to benefit the broader engineering organization.
Governance and Compliance
• Follow enterprise policies governing AI usage, intellectual property protection, security, privacy, PHI handling, and Responsible AI practices.
• Ensure no confidential, regulated, or protected information (including PHI in test data) is used with unapproved AI services or tooling; use synthetic data for testing.
• Participate in peer reviews and validation processes for AI-assisted solutions.
Required Qualifications
• 5+ years of experience in software quality assurance, including 3+ years of hands-on test automation for modern web applications.
• Strong hands-on experience with Playwright using TypeScript or JavaScript for end-to-end automation.
• Experience with component testing using Vitest or Jest and React Testing Library.
• Experience testing React-based web applications, including asynchronous and streaming behavior.
• Hands-on accessibility testing experience with axe-core and manual screen readers (JAWS, NVDA, VoiceOver) against WCAG 2.1/2.2 AA and Section 508.
• Experience with API testing and contract testing, including schema-based validation of APIs or event streams.
• Experience with load or performance testing tools (e.g., k6, JMeter).
• Experience creating and maintaining automation jobs in CI/CD tools (e.g., GitHub Actions with YAML) and version control with Git.
• Knowledge of test management and defect tracking tools (e.g., JIRA, ALM).
• In-depth knowledge of testing methodologies, including functional, regression, accessibility, and performance testing.
• Experience working in Agile development environments.
• Strong problem-solving skills and a proactive approach to troubleshooting and issue resolution.
• Excellent communication and collaboration skills, with the ability to mentor others.
Preferred Qualifications
• Experience evaluating AI or LLM output using test datasets, scoring rubrics, or evaluation frameworks.
• Familiarity with AG-UI, CopilotKit, the Vercel AI SDK, or other streaming (SSE) agent interfaces.
• Experience with Python for test tooling or agent evaluation.
• Experience using AI-assisted testing tools such as GitHub Copilot or Playwright MCP.
• Experience with FHIR R4 test data; Da Vinci Prior Authorization Support (PAS) a plus.
• Familiarity with OpenTelemetry for diagnosing test failures.
• Experience in healthcare or other regulated environments handling PHI.
Education
• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related field, or equivalent experience.
To ensure a secure hiring process we have implemented several identity verification steps, including submission of a government issued photo ID. We conduct identity verification during interviews, and final interviews may require onsite attendance. All candidates must complete a comprehensive background check, in-person I-9 verification, and may be subject to drug screening prior to employment. The use of artificial intelligence tools during interviews is prohibited and monitored. Misrepresentation will result in immediate disqualification from consideration.
Technical Requirements:
We require that all employees have the following technical capability at their home: High speed internet over 10 Mbps and, specifically for all call center employees, the ability to plug in directly to the home internet router.
Evolent is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability status. If you need reasonable accommodation to access the information provided on this website, please contact [email protected] for further assistance.
The expected base salary/wage range for this position is $115,000- 120,000. As part of our total compensation package, Evolent is proud to offer comprehensive benefits (including health insurance benefits) to qualifying employees. All compensation determinations are based on the skills and experience required for the position and commensurate with experience of selected individuals, which may vary above and below the stated amounts.Skills Required
- 5+ years of software quality assurance experience
- 3+ years of hands-on test automation for modern web applications
- Hands-on Playwright experience using TypeScript or JavaScript for end-to-end automation
- Component testing experience with Vitest or Jest and React Testing Library
- Experience testing React-based web applications, including asynchronous and streaming behavior
- Hands-on accessibility testing with axe-core and manual screen readers, including JAWS, NVDA, and VoiceOver, against WCAG 2.1/2.2 AA and Section 508
- API and contract testing experience, including schema-based validation of APIs or event streams
- Experience with load or performance testing tools such as k6 or JMeter
- Experience creating and maintaining automation jobs in CI/CD tools such as GitHub Actions with YAML
- Version control experience with Git
- Knowledge of test management and defect tracking tools such as JIRA or ALM
- In-depth knowledge of functional, regression, accessibility, and performance testing methodologies
- Experience working in Agile development environments
- Strong problem-solving and troubleshooting skills
- Excellent communication and collaboration skills, including mentoring ability
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field, or equivalent experience
- Experience evaluating AI or LLM output using test datasets, scoring rubrics, or evaluation frameworks
- Familiarity with AG-UI, CopilotKit, Vercel AI SDK, or other streaming SSE agent interfaces
- Experience with Python for test tooling or agent evaluation
- Experience using AI-assisted testing tools such as GitHub Copilot or Playwright MCP
- Experience with FHIR R4 test data; Da Vinci Prior Authorization Support is a plus
- Familiarity with OpenTelemetry for diagnosing test failures
- Healthcare or regulated-environment experience involving PHI
Evolent Health Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Evolent Health and has not been reviewed or approved by Evolent Health.
-
Leave & Time Off Breadth — Salaried roles commonly include unlimited PTO alongside paid holidays, volunteer time off, and a sabbatical option after several years. Feedback suggests time-off flexibility is a meaningful lifestyle strength for many roles.
-
Healthcare Strength — Comprehensive medical, dental, and vision coverage is paired with a publicly highlighted emphasis on mental-health resources, including a 2026 Gold Bell Seal from Mental Health America. This recognition signals above-baseline support for employee health needs.
-
Wellbeing & Lifestyle Benefits — A remote-first approach for most positions and flexible work arrangements are consistently emphasized. Feedback suggests these elements add notable non-cash value to the overall package.
Evolent Health Insights
What We Do
Evolent Health delivers proven clinical and administrative solutions that improve whole person health while making health care simpler and more affordable. Our three solutions—Evolent Care Partners, New Century Health and Evolent Health Services—encompass total cost of care management, specialty care management and administrative simplification. Evolent serves a national base of leading payers and providers, is the first company to receive the National Committee for Quality Assurance's Population Health Program Accreditation, and is consistently recognized as a top place to work in health care nationally. OUR PEOPLE We were named one of “Becker’s 150 Great Places to Work in Healthcare” in 2016, 2017, 2018 and 2019 and are proud to be recognized as a leader in driving diversity, equity, and inclusion (DE&I) efforts. Evolent achieved a 100% score on the 2020 Human Rights Campaign's Corporate Equality Index, making us one of the best places to work for LGBTQ+ employees. We were also named on the Best Companies for Women to Advance List 2020 and 2021 by Parity.org. OUR CULTURE Our accessible leadership team cultivates an open-door environment. We don’t like approval chains; we love ideas and people with the courage and conviction to bring novel solutions forward. We win as a team and always ask how we can do better. We respect and encourage commitments outside of work. OUR COMPENSATION & BENEFITS We recognize and reward our most valuable asset—our team—with competitive pay and annual performance-based bonuses. Evolent also offers comprehensive health benefits, a company-matched 401(k) and flexible spending accounts. Every salaried Evolent employee receives unlimited Personal Time Off and is eligible for a month-long sabbatical after working five years with Evolent. This account is monitored closely by our company. Please message us at [email protected] with any questions or concerns.
