Senior TAE

Posted 14 Days Ago
Be an Early Applicant
2 Locations
In-Office
Senior level
Artificial Intelligence • Big Data • Machine Learning
The Role
Senior Test Automation Engineer responsible for defining test architecture and quality strategy across UI, API, database, and AI/LLM systems. Build and maintain automation frameworks (Playwright/Selenium) integrated with CI/CD, drive API and backend testing, validate LLM/agent behavior and model quality, mentor QA teams, and ensure scalable test data and pipeline validation.
Summary Generated by Built In

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Role - Senior/ Associate/ Lead - Test Automation Engineer

Experience4 - 12 years

Location : Mumbai/ Bangalore
 

Job Summary

We are seeking a highly skilled Associate Lead QA Engineer / Principal QA Engineer who will function as a senior individual contributor while influencing test architecture, quality strategy, and best practices across teams. The role demands deep hands-on expertise in UI, API, Database, Automation, and AI/LLM testing, with the ability to design scalable test approaches for modern applications.

1. Core QA & Testing Fundamentals:

  • Manual testing (functional, regression, smoke, sanity)

  • UI/UX validation across browsers & devices

  • Strong understanding of test design techniques & defect lifecycle

  • Test Strategy & planning: Develop comprehensive test plans and strategies for web applications, APIs, cloud services, 

  • Test Data Management: Test data creation, management, and cleanup strategies 

  • Mentoring and leading a team of 2-3 testers

2. API Testing

  • Hands-on with Postman, REST Assured

  • Clear understanding of RESTful APIs, GraphQL, WebSockets

  • Ability to validate API contracts, response formats, schema, and error codes

3.  Automation Testing:

  • Experience building or maintaining automated test frameworks in Python/Java/TS/JS

  • Automation Tool :Playwright, Selenium

  • CI/CD Integration: Integrating automated tests into CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions)

4. AI / LLM / Agent Testing: 

  • Familiarity with LangChain / LangGraph (agent workflows, memory, tools)

  • Experience in prompt testing, multi-turn flow validation & LLM response evaluation

  • Model evaluation concepts (accuracy, precision, recall, hallucination detection)

  • Data validation within ML pipelines

Good-to-Have Skills

1. Data Pipeline & Backend Testing

  • ETL/ELT validation (Airflow, dbt, Spark)

  • Strong SQL for backend/database testing

2. Performance /Load Testing

3. 2-3 years working on cloud - Azure or AWS

4. 3-5 years of Experience working in Healthcare domain


Key Responsibilities:

  • Define Test Architecture & Strategy :Own the end-to-end test architecture and quality strategy across UI, API, database, and AI-driven systems, ensuring scalability, reliability, and alignment with business goals.

  • Lead Automation Framework Design:Architect and govern robust UI and API automation frameworks (Playwright/Selenium), integrated with CI/CD pipelines and designed for long-term maintainability.

  • Drive API & Backend Quality:Establish best practices for API, integration, and database testing, including contract validation, data integrity checks, and end-to-end backend workflows.

  • Own AI & Agentic System Testing:Define testing approaches for AI agents and LLM-based features, including response validation, hallucination detection, bias checks, prompt behavior, and multi-agent workflows.

  • Mentor & Coach QA Teams:Mentor senior testers and automation engineers, review designs and code, and uplift team capability in modern testing, automation, and AI quality practices.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Skills Required

  • 4-12 years experience in QA/Test Automation
  • Manual testing (functional, regression, smoke, sanity)
  • UI/UX validation across browsers and devices
  • Strong understanding of test design techniques and defect lifecycle
  • Test strategy and planning for web, APIs and cloud services
  • Test data creation, management, and cleanup strategies
  • Mentoring and leading a team of 2-3 testers
  • API testing with Postman and REST Assured
  • Clear understanding of RESTful APIs, GraphQL, WebSockets
  • Experience building or maintaining automated test frameworks in Python, Java, TypeScript or JavaScript
  • Automation tools: Playwright or Selenium
  • CI/CD integration of automated tests (Jenkins, GitLab CI, GitHub Actions)
  • Familiarity with LangChain or LangGraph and LLM/agent testing concepts
  • Prompt testing, multi-turn flow validation and LLM response evaluation
  • Model evaluation concepts (accuracy, precision, recall, hallucination detection)
  • Data validation within ML pipelines
  • Strong SQL for backend/database testing
  • ETL/ELT validation experience (Airflow, dbt, Spark)
  • Performance / Load testing experience
  • 2-3 years working on cloud (Azure or AWS)
  • 3-5 years experience in Healthcare domain

Quantiphi Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Quantiphi and has not been reviewed or approved by Quantiphi.

  • Wellbeing & Lifestyle Benefits Wellbeing initiatives such as monthly meeting-free AMA-Zen Days, health check-ups, and wellness counseling are designed to reduce burnout and support day-to-day balance. Broader wellness programs reinforce both physical and mental health.
  • Flexible Benefits Remote/hybrid options with flexible working hours provide meaningful autonomy over where and when work gets done. Flexible leave constructs, including sabbaticals and special day leaves, add practical adaptability to the package.
  • Parental & Family Support Paid parental leave in the U.S., alongside maternity and childcare support, signals solid backing for families. These family-oriented policies integrate with a wider health and wellness focus.

Quantiphi Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Marlborough, MA
3,494 Employees
Year Founded: 2013

What We Do

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.

Similar Jobs

HERE Technologies Logo HERE Technologies

Data Scientist

Artificial Intelligence • Automotive • Computer Vision • Information Technology • Internet of Things • Logistics • Software
Hybrid
Navi Mumbai, Thane, Maharashtra, IND
6000 Employees
Hybrid
Mumbai, Maharashtra, IND
289097 Employees
Hybrid
Mumbai, Maharashtra, IND
289097 Employees

JPMorganChase Logo JPMorganChase

Data Analyst

Financial Services
Hybrid
2 Locations
289097 Employees

Similar Companies Hiring

Legora Thumbnail
Artificial Intelligence • Legal Tech • Software
New York, New York
700 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account