Your Future Evolves Here
Evolent partners with health plans and providers to achieve better outcomes for people with most complex and costly health conditions. Working across specialties and primary care, we seek to connect the pieces of fragmented health care system and ensure people get the same level of care and compassion we would want for our loved ones.
Evolent employees enjoy work/life balance, the flexibility to suit their work to their lives, and autonomy they need to get things done. We believe that people do their best work when they're supported to live their best lives, and when they feel welcome to bring their whole selves to work. That's one reason why diversity and inclusion are core to our business.
Join Evolent for the mission. Stay for the culture.
What You’ll Be Doing:
Position Summary
The Quality Engineer develops and executes test plans, performs exploratory and automated testing, and builds and maintains automated tests for the Evolent Platform web user experience. Working in an Agile, globally dispersed team, this role partners with developers, business analysts, and stakeholders to understand requirements and expected agent behavior, surface quality issues early, and report clearly on quality status.
This individual works with minimal supervision on assigned features, actively learning and adopting the testing methods, automation frameworks, and patterns defined for the role and by the team. The role is expected to use approved AI-assisted tools to accelerate testing and improve quality while remaining fully accountable for every delivered result.
AI-Assisted Engineering Expectations
Evolent engineers are expected to effectively leverage approved AI-assisted development and productivity tools (e.g., code assistants, copilots, automation agents, knowledge assistants, and analytics tools) to improve quality, efficiency, and innovation while maintaining accountability for all delivered work. These expectations span the full engineering lifecycle, not only code generation, including iterating with AI on test design and solution design, evaluating alternatives, and producing design artifacts. Engineers remain responsible for validating outputs, ensuring solution quality, protecting sensitive information, and complying with security, privacy, regulatory, and Responsible AI standards.
Key Responsibilities
Test Planning and Execution
• Develop, document, and execute test plans and test cases for assigned features.
• Perform exploratory and automated testing to ensure software functionality, reliability, and performance.
• Conduct regression testing to ensure new code does not adversely impact existing functionality.
• Collaborate with development teams to understand requirements, expected agent behavior, and human-in-the-loop flows, and identify potential quality issues early.
• Participate in code reviews, design discussions, and sprint planning, and contribute to the design and implementation of enhancements to the team’s test systems.
Test Automation and CI/CD
• Create and maintain Playwright end-to-end tests and Vitest component tests using the team’s established frameworks and patterns.
• Execute and maintain contract tests and API tests using the team’s established tooling.
• Test streaming, loading, and error states, including slow and failed agent responses.
• Execute automated test suites in GitHub Actions, evaluate results, and fix failing scripts to maintain a high pass rate.
• Create and maintain synthetic test data.
• Follow and help reinforce the team’s testing processes and automation standards, holding peers accountable constructively and making sure the team understands the risks of exceptions.
Accessibility Testing
• Run automated axe-core accessibility checks and manual screen reader tests (JAWS, NVDA, VoiceOver) against WCAG 2.1/2.2 AA.
Defect Management and Quality Reporting
• Identify, isolate, document, and track defects, working closely with developers to ensure timely resolution.
• Analyze test and evaluation results, generate quality metrics, and report on software quality status to the team and stakeholders.
• Present work in Agile ceremonies, participate in knowledge-sharing sessions, and seek feedback to continuously improve skills.
AI-Enabled Quality Engineering
• Utilize approved AI-assisted engineering tools to accelerate test case design, test script development, test data generation, documentation, and troubleshooting.
• Evaluate and validate AI-generated tests, scripts, and analysis for correctness, security, maintainability, compliance, and business appropriateness before use.
• Learn and adopt the prompts, skills, agents, and AI-assisted testing patterns defined by the team and share improvements that benefit the team.
• Identify opportunities to improve testing productivity and quality through AI-enabled workflows and automation.
Governance and Compliance
• Follow enterprise policies governing AI usage, intellectual property protection, security, privacy, PHI handling, and Responsible AI practices.
• Ensure no confidential, regulated, or protected information (including PHI in test data) is used with unapproved AI services or tooling; use synthetic data for testing.
• Participate in peer reviews and validation processes for AI-assisted solutions.
Required Qualifications
• 3+ years of experience in software quality assurance or testing, including hands-on UI test automation.
• Experience with Playwright or similar end-to-end automation tools, preferably using TypeScript or JavaScript.
• Working knowledge of JavaScript or TypeScript for test automation.
• Familiarity with component testing frameworks such as Vitest or Jest.
• Familiarity with API testing tools (e.g., Postman) and REST APIs.
• Familiarity with CI/CD tools (e.g., GitHub Actions) and version control systems such as Git.
• Familiarity with test management and defect tracking tools (e.g., JIRA, ALM).
• Proficiency in software testing methodologies, including functional, regression, and performance testing.
• Knowledge of Agile methodologies and experience working in an Agile development environment.
• Strong analytical skills and attention to detail, with a focus on troubleshooting and problem-solving.
• Excellent communication skills, openness to feedback, and the ability to collaborate effectively with cross-functional teams.
Preferred Qualifications
• Exposure to testing AI or LLM output using test datasets and scoring rubrics.
• Familiarity with testing React applications and streaming user interfaces.
• Familiarity with contract testing and basic load testing.
• Working knowledge of accessibility testing, including axe-core and screen readers (JAWS, NVDA, or VoiceOver).
• Exposure to AI-assisted testing tools such as GitHub Copilot or Playwright MCP.
• Familiarity with FHIR R4.
• Experience in healthcare or other regulated environments handling PHI.
Education
• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related field, or equivalent experience.
#EvolentAi
To ensure a secure hiring process we have implemented several identity verification steps, including submission of a government issued photo ID. We conduct identity verification during interviews, and final interviews may require onsite attendance. All candidates must complete a comprehensive background check, in-person I-9 verification, and may be subject to drug screening prior to employment. The use of artificial intelligence tools during interviews is prohibited and monitored. Misrepresentation will result in immediate disqualification from consideration.
Technical Requirements:
We require that all employees have the following technical capability at their home: High speed internet over 10 Mbps and, specifically for all call center employees, the ability to plug in directly to the home internet router.
Evolent is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability status. If you need reasonable accommodation to access the information provided on this website, please contact [email protected] for further assistance.
The expected base salary/wage range for this position is $91,000-96,000. As part of our total compensation package, Evolent is proud to offer comprehensive benefits (including health insurance benefits) to qualifying employees. All compensation determinations are based on the skills and experience required for the position and commensurate with experience of selected individuals, which may vary above and below the stated amounts.Skills Required
- 3+ years of experience in software quality assurance or testing, including hands-on UI test automation
- Experience with Playwright or similar end-to-end automation tools, preferably using TypeScript or JavaScript
- Working knowledge of JavaScript or TypeScript for test automation
- Familiarity with component testing frameworks such as Vitest or Jest
- Familiarity with API testing tools such as Postman and REST APIs
- Familiarity with CI/CD tools such as GitHub Actions and version control systems such as Git
- Familiarity with test management and defect tracking tools such as JIRA or ALM
- Proficiency in functional, regression, and performance testing methodologies
- Knowledge of Agile methodologies and experience in an Agile development environment
- Strong analytical skills and attention to detail, with troubleshooting and problem-solving ability
- Excellent communication skills and ability to collaborate effectively with cross-functional teams
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, or related field, or equivalent experience
- Exposure to testing AI or LLM output using test datasets and scoring rubrics
- Familiarity with testing React applications and streaming user interfaces
- Familiarity with contract testing and basic load testing
- Working knowledge of accessibility testing, including axe-core and screen readers such as JAWS, NVDA, or VoiceOver
- Exposure to AI-assisted testing tools such as GitHub Copilot or Playwright MCP
- Familiarity with FHIR R4
- Experience in healthcare or other regulated environments handling PHI
Evolent Health Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Evolent Health and has not been reviewed or approved by Evolent Health.
-
Leave & Time Off Breadth — Salaried roles commonly include unlimited PTO alongside paid holidays, volunteer time off, and a sabbatical option after several years. Feedback suggests time-off flexibility is a meaningful lifestyle strength for many roles.
-
Healthcare Strength — Comprehensive medical, dental, and vision coverage is paired with a publicly highlighted emphasis on mental-health resources, including a 2026 Gold Bell Seal from Mental Health America. This recognition signals above-baseline support for employee health needs.
-
Wellbeing & Lifestyle Benefits — A remote-first approach for most positions and flexible work arrangements are consistently emphasized. Feedback suggests these elements add notable non-cash value to the overall package.
Evolent Health Insights
What We Do
Evolent Health delivers proven clinical and administrative solutions that improve whole person health while making health care simpler and more affordable. Our three solutions—Evolent Care Partners, New Century Health and Evolent Health Services—encompass total cost of care management, specialty care management and administrative simplification. Evolent serves a national base of leading payers and providers, is the first company to receive the National Committee for Quality Assurance's Population Health Program Accreditation, and is consistently recognized as a top place to work in health care nationally. OUR PEOPLE We were named one of “Becker’s 150 Great Places to Work in Healthcare” in 2016, 2017, 2018 and 2019 and are proud to be recognized as a leader in driving diversity, equity, and inclusion (DE&I) efforts. Evolent achieved a 100% score on the 2020 Human Rights Campaign's Corporate Equality Index, making us one of the best places to work for LGBTQ+ employees. We were also named on the Best Companies for Women to Advance List 2020 and 2021 by Parity.org. OUR CULTURE Our accessible leadership team cultivates an open-door environment. We don’t like approval chains; we love ideas and people with the courage and conviction to bring novel solutions forward. We win as a team and always ask how we can do better. We respect and encourage commitments outside of work. OUR COMPENSATION & BENEFITS We recognize and reward our most valuable asset—our team—with competitive pay and annual performance-based bonuses. Evolent also offers comprehensive health benefits, a company-matched 401(k) and flexible spending accounts. Every salaried Evolent employee receives unlimited Personal Time Off and is eligible for a month-long sabbatical after working five years with Evolent. This account is monitored closely by our company. Please message us at [email protected] with any questions or concerns.
