QA Engineer – AI Voice Bot Testing

Posted 2 Days Ago
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Healthtech
The Role
Validate AI voice bot functionality by creating/executing test cases from business documents, running functional/regression/integration/API tests, verifying conversational flows and intent recognition, supporting automation efforts, managing defects, and assisting production validation and release activities.
Summary Generated by Built In

Job Title: QA Engineer – AI Voice Bot Testin

Experience: 5+ Years

Location: Hyderabad, India

Employment Type: Full-time

About NationsBenefits:

At NationsBenefits, we are leading the transformation of the insurance industry by developing innovative benefits management solutions. We focus on modernizing complex back-office systems to create scalable, secure, and high-performing platforms that streamline operations for our clients. As part of our strategic growth, we are focused on platform modernization — transitioning legacy systems to modern, cloud-native architectures that support the scalability, reliability, and high performance of core backoffice functions in the insurance domain.

Role Summary:
We are looking for a skilled and detail-oriented QA Engineer to support testing activities for AI-powered voice bot solutions. The QA Engineer will work closely with the Testing Lead, Product team, Operations team, and Development team to validate business functionality, conversational workflows, and system integrations.The ideal candidate should have strong experience in software testing, automation, and production support, along with the ability to create and execute test cases based on
Business Documents (BDs) and functional requirements.

Key Responsibilities:
Functional & Business Testing

• Review Business Documents (BDs), user stories, and functional requirements to
create test cases and test scenarios.
• Execute functional, regression, integration, and user acceptance testing for AI voice
bot applications.
• Validate conversational flows, business rules, API integrations, and escalation
workflows.
• Ensure voice bot responses and workflows align with business and operational
requirements.
Collaboration & Coordination

• Work closely with:
o Testing Lead for test planning and execution activities.
o Operations teams to understand customer interaction flows and business
processes.
o Product teams to validate feature requirements and acceptance criteria.
o Development teams for defect tracking and issue resolution.
• Participate in sprint planning, requirement reviews, and release activities.
Automation & AI Testing Support

• Support development and execution of automation test scripts and AI-driven testing
solutions.
• Assist in testing AI voice bots for:
o Intent recognition
o Response validation
o Workflow accuracy
o Business functionality
• Contribute to improving automation coverage and testing efficiency.
Defect Management & Reporting

• Identify, log, track, and retest defects using defect management tools.
• Prepare test execution reports and communicate testing status to the Testing Lead.
• Support production validation and post-release monitoring activities.

Required Qualifications:
• 5+ years of experience in Software Testing, Application Support, or QA Engineering.
• Strong understanding of software testing methodologies and QA processes.
• Experience creating and executing test cases from Business Documents (BDs) and
functional requirements.
• Experience in functional testing, regression testing, integration testing, and API
testing.
• Exposure to AI Voice Bots, Chatbots, IVR systems, or Conversational AI platforms.
• Knowledge of automation testing tools such as Selenium, Cypress, Playwright, or
similar.
• Familiarity with Agile/Scrum methodologies.
• Strong analytical and communication skills.

Preferred Skills:
• Experience with Conversational AI platforms such as Dialogflow, Amazon Lex, or
Microsoft Bot Framework.
• Exposure to NLP and speech-to-text testing.
• Knowledge of SQL, API testing tools (Postman, Swagger), and defect tracking tools
(JIRA, Azure DevOps).
• Experience supporting production releases and troubleshooting issues.
Reporting Structure
• Reporting To: Testing Lead / QA Lead
• Team Collaboration: Product, Operations, Development, and Support Teams
Success Metrics
• Accurate and comprehensive test execution.
• Reduced production defects and improved release quality.
• Increased automation coverage and testing efficiency.
• Timely defect identification and resolution support.
• Improved voice bot performance and customer experience.

Skills Required

  • 5+ years of experience in Software Testing, Application Support, or QA Engineering.
  • Strong understanding of software testing methodologies and QA processes.
  • Experience creating and executing test cases from Business Documents (BDs) and functional requirements.
  • Experience in functional testing, regression testing, integration testing, and API testing.
  • Exposure to AI Voice Bots, Chatbots, IVR systems, or Conversational AI platforms.
  • Knowledge of automation testing tools such as Selenium, Cypress, Playwright, or similar.
  • Familiarity with Agile/Scrum methodologies.
  • Strong analytical and communication skills.
  • Experience with Conversational AI platforms such as Dialogflow, Amazon Lex, or Microsoft Bot Framework.
  • Exposure to NLP and speech-to-text testing.
  • Knowledge of SQL, API testing tools (Postman, Swagger), and defect tracking tools (JIRA, Azure DevOps).
  • Experience supporting production releases and troubleshooting issues.

NationsBenefits Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NationsBenefits and has not been reviewed or approved by NationsBenefits.

  • Fair & Transparent Compensation Pay is frequently characterized as decent or good for certain entry-level and frontline roles, with timely pay also highlighted. Compensation is sometimes positioned as competitive relative to the work performed in those positions.
  • Leave & Time Off Breadth Unlimited PTO is described as available for some salaried roles, which can increase perceived flexibility. Paid holidays and paid time off are presented as part of the standard package for eligible employees.
  • Wellbeing & Lifestyle Benefits A fitness stipend and occasional company-sponsored outings or training-related perks are included among the extra benefits. These additions can modestly strengthen the overall rewards experience beyond core insurance.

NationsBenefits Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Costa Mesa, CA
115 Employees
Year Founded: 2015

What We Do

NationsBenefits® is a leading supplemental benefits company providing managed care organizations with innovative healthcare solutions helping to promote independence, health, and well-being for more than 20 million members across the U.S. When the company was founded in 2015 by Glenn Parker, M.D., we set out to disrupt the healthcare industry. In 2020, we rebranded to NationsBenefits to expand the company’s core offering and broaden the scope of our clinically focused services. Today, we surpass traditional benefit management programs by helping our health plan partners drive growth, improve outcomes, reduce costs, and delight members. Our best-in-class service model engages members in meaningful and measurable ways with technology-based solutions tailored to the unique needs of each population.

Similar Jobs

Hybrid
Hyderabad, Telangana, IND
205000 Employees
Hybrid
Hyderabad, Telangana, IND
205000 Employees
Hybrid
Hyderabad, Telangana, IND
205000 Employees

Wells Fargo Logo Wells Fargo

Consultant

Fintech • Financial Services
Hybrid
Hyderabad, Telangana, IND
205000 Employees

Similar Companies Hiring

Sailor Health Thumbnail
Healthtech • Social Impact • Telehealth
New York City, NY
20 Employees
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account