QA Engineer

Posted 13 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Mid level
Healthtech
The Role
The QA Engineer will design and maintain automation frameworks, validate AI/ML systems, and automate testing processes, ensuring high-quality AI applications.
Summary Generated by Built In

Title: QA Engineer

Reporting to: Director, QA Engineering
Location: Bengaluru (Bangalore)

Opportunity:

We are seeking a skilled AI QA Engineer with 4–6 years of experience in test automation and a strong focus on validating AI/ML and LLM-based systems. The ideal candidate will have hands-on expertise in automation frameworks, API/UI testing, and experience in validating NLP/LLM models across complex, data-driven applications.

Key Responsibilities
  • Design, develop, and maintain scalable automation frameworks for UI, API, and backend systems
  • Perform end-to-end testing of AI/ML pipelines, including NLP and LLM-based applications
  • Validate LLM outputs using techniques such as prompt validation, response scoring, and model comparison
  • Build and execute test strategies for microservices and event-driven architectures
  • Conduct data validation across systems using SQL/BigQuery and ensure data accuracy in pipelines
  • Automate regression, smoke, and end-to-end test suites to improve coverage and efficiency
  • Integrate automated tests into CI/CD pipelines using Jenkins or similar tools
  • Collaborate with developers, data scientists, and product teams to ensure high-quality AI solutions
  • Analyze defects, identify root causes, and ensure timely resolution
  • Continuously improve test frameworks, tools, and processes
Required Skills & QualificationsAutomation & Testing
  • Strong experience in Selenium WebDriver, RestAssured, TestNG
  • Expertise in API Testing, UI Testing, and Microservices Testing
  • Experience in building Hybrid/POM-based automation frameworks
Programming
  • Proficiency in Java (mandatory)
  • Basic working knowledge of Python
AI / ML / LLM Testing
  • Experience testing NLP/LLM models (e.g., BERT, GPT-based models, QWEN, Gemini)
  • Knowledge of NER validation, prompt testing, and output evaluation techniques
  • Exposure to model validation, scoring mechanisms, and dataset validation
Data & Cloud
  • Strong SQL skills with experience in BigQuery or similar platforms
  • Understanding of event-driven systems (Pub/Sub or similar)
  • Experience in validating JSON-based data pipelines
DevOps & Tools
  • Experience with Jenkins, Maven, Git/Bitbucket
  • Knowledge of CI/CD pipeline integration and test reporting (Allure or similar)
Good to Have
  • Experience in Healthcare, OTT, or E-commerce domains
  • Exposure to EMR/EHR systems or clinical data validation
  • Knowledge of UMLS, CUI mapping, or healthcare NLP concepts
  • Experience with mobile testing (Appium)
Experience
  • 4–6 years of experience in QA Automation / SDET roles
  • Hands-on experience in AI/ML or LLM validation is highly preferred
Education
  • Bachelor’s degree in Engineering, Computer Science, or related field

About Get Well:

Now part of the SAI Group family, Get Well is redefining digital patient engagement by putting patients in control of their personalized healthcare journeys, both inside and outside the hospital. Get Well is combining high-tech AI navigation with high-touch care experiences driving patient activation, loyalty, and outcomes while reducing the cost of care. For almost 25 years, Get Well has served more than 10 million patients per year across over 1,000 hospitals and clinical partner sites, working to use longitudinal data analytics to better serve patients and clinicians. AI innovator SAI Group led by Chairman Romesh Wadhwani is the lead growth investor in Get Well. Get Well’s award-winning solutions were recognized again in 2024 by KLAS Research and AVIA Marketplace. Learn more at Get Well and follow-us on LinkedIn and Twitter.

Get Well is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age or veteran status.

About SAI Group:

  • SAIGroup commits to $1 Billion capital, an advanced AI platform that currently processes 300M+ patients, and 4000+ global employee base to solve enterprise AI and high priority healthcare problems. SAIGroup - Growing companies with advanced AIhttps://www.cnbc.com/2023/12/08/75-year-old-tech-mogul-betting-1-billion-of-his-fortune-on-ai-future.html
  • Bio of our Chairman Dr. Romesh Wadhwani: Team - SAIGroup (Informal at Romesh Wadhwani - Wikipedia)
  • TIME Magazine recently recognized Chairman Romesh Wadhwani as one of the Top 100 AI leaders in the world - Romesh and Sunil Wadhwani: The 100 Most Influential People in AI 2023 | TIME
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Bethesda, MD
435 Employees
Year Founded: 2000

What We Do

Our mission is in the name: Get Well. With more than 20 years of digital patient engagement experience, Get Well leads the evolution of personalized care. By connecting the art and science of patient engagement, we provide digital technology that guides patients at every step of the healthcare journey. Get Well’s digital engagement tools connect patients to the information they need, when they need it, providing scalable operational efficiencies to hospitals, health systems, payers, and other risk-bearing entities that help improve outcomes and create a more equitable healthcare system for all.

Similar Jobs

In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
435 Employees
Remote or Hybrid
2 Locations
132624 Employees

Deutsche Bank Logo Deutsche Bank

Quality Assurance Engineer

Fintech • Financial Services
In-Office
M. G. Road, Bengaluru North, Bangalore, Karnataka, IND
68787 Employees

Wispr Logo Wispr

Quality Assurance Engineer

Artificial Intelligence • Consumer Web • Wearables
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
49 Employees

Similar Companies Hiring

Camber Thumbnail
Fintech • Healthtech • Social Impact
New York, New York
90 Employees
Sailor Health Thumbnail
Healthtech • Social Impact • Telehealth
New York City, NY
20 Employees
Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account