The Role
Lead QA engineer responsible for designing and executing test strategies for web and microservice features including AI-enabled components. Perform functional, regression, integration, API, accessibility (JAWS), and conversational/RAG validation testing. Automate tests with Selenium and Jenkins, collaborate with Product, AI Architects, and SMEs, and drive quality best practices across provider, benefits, cost, claims, and contact center integrations.
Summary Generated by Built In
Lead Quality Engineer
Primary Skills
- Test Data Management, Jenkins, Postman, Selenium, BDD - Behavior Driven Development, SoapUI, System Integration testing, Zephyr, TDD - Test Driven Development, Accessibility Testing (JAWS), Cucumber
Job requirements
- Design and implement comprehensive test strategies for traditional and AI-powered features within the Personal Health Concierge platform, prioritizing high-impact areas
- Develop and execute detailed test scenarios based on business requirements and acceptance criteria across provider search, facility search, symptom guidance, benefits navigation, cost estimation, claims status, and contact center handoff modules
- Perform functional, regression, integration, and system testing to ensure measurable quality and compliance of web applications and microservices
- Validate chatbot conversations, AI-generated responses, and RAG-based retrieval accuracy, ensuring prompt behavior and guardrail compliance for healthcare-specific use cases
- Conduct API and integration testing for provider directory APIs, benefits and eligibility APIs, claims APIs, cost estimation services, AI gateway services, and contact center integrations
- Collaborate with Product Owners, AI Architects, Developers, and Business SMEs to establish robust quality engineering practices and drive continuous improvement
- Leverage automation tools such as Selenium and Jenkins to streamline testing workflows and increase coverage
- Perform accessibility testing using JAWS to ensure compliance with accessibility standards across the platform
- 1. Cucumber
- 2. AI validation and conversational testing
- 3. Healthcare domain expertise
- 4. Advanced API automation
- 5. Experience with contact center integrations (Avaya)
- 6. RAG (Retrieval-Augmented Generation) testing
- 1. Bachelor's degree in Computer Science, Information Technology, or a closely related discipline
- 2. Certified Software Quality Engineer (CSQE) or ISTQB Advanced Level Test Analyst certification
- 3. Certification in AI or Machine Learning testing methodologies (preferred for AI-enabled application testing)
Experience Range:
With at least 4 years of experience in quality engineering for web applications and microservices, including hands-on testing of AI-enabled applications
Key Responsibilities:
Required Skills:
1. Jenkins
2. Postman
3. Selenium
4. Behavior Driven Development (BDD)
5. SoapUI
6. System Integration Testing
7. Zephyr
8. Test Driven Development (TDD)
9. Accessibility Testing with JAWS
Preferred Skills:
Desired Qualifications:
Additional Information:
This is a QA Engineer role focused on AI-enabled applications, not a typical QA position.
Skills Required
- At least 4 years of experience in quality engineering for web applications and microservices, including hands-on testing of AI-enabled applications
- Jenkins
- Postman
- Selenium
- Behavior Driven Development (BDD)
- SoapUI
- System Integration Testing
- Zephyr
- Test Driven Development (TDD)
- Accessibility testing using JAWS
- Test Data Management
- Cucumber
- AI validation and conversational testing (chatbot, AI-generated responses)
- Healthcare domain expertise
- Advanced API automation
- Experience with contact center integrations (Avaya)
- RAG (Retrieval-Augmented Generation) testing
- Bachelor's degree in Computer Science, Information Technology, or closely related discipline
- CSQE or ISTQB Advanced Level Test Analyst certification
- Certification in AI or Machine Learning testing methodologies
Brillio Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Brillio and has not been reviewed or approved by Brillio.
-
Healthcare Strength — Healthcare is considered comprehensive, including medical coverage for employees and dependents alongside life, disability, and accidental death protections. Feedback suggests these protections are a core strength of the package.
-
Leave & Time Off Breadth — Time-off options include paid leave and parental leave, with flexible or ‘flexible PTO’ approaches cited in some contexts. Feedback suggests this breadth helps support work-life balance when team norms permit usage.
-
Wellbeing & Lifestyle Benefits — Wellbeing offerings span counseling, financial-management sessions, fitness programs, and travel insurance, plus region-specific extras like discounted IT hardware and work-from-home essentials. Feedback suggests these add-ons enhance perceived value beyond core insurance.
Brillio Insights
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.
