Senior AI QA Engineer

Reposted 22 Days Ago
Hiring Remotely in India
Remote
Senior level
Software • Database • Analytics
The Role
The Senior AI QA Engineer will oversee test planning, automation framework development, API testing, and ensure high-quality AI solutions. Responsibilities include end-to-end testing across AI/ML systems, collaboration with data and DevOps teams, and mentoring junior QA members.
Summary Generated by Built In

Job Title: Senior AI QA Engineer
Experience Required: 4–6 Years
Employment Type: Full-Time
Work Mode: Remote
Location: India

Job Summary

We are seeking a Senior AI QA Engineer with 4–6+ years of experience in software quality assurance, test automation, and validation of data-driven and AI/ML systems. The role involves test planning, automation framework development, API testing, CI/CD integration, and end-to-end testing of AI and data pipelines. The candidate will work closely with engineering, data, and DevOps teams to ensure high-quality, scalable AI solutions.

Key Responsibilities
  • Define and execute test planning, test strategy, and test cases for AI/ML and data-driven applications
  • Develop and maintain automated test frameworks using Selenium and Pytest
  • Perform API testing for RESTful services
  • Validate data pipelines, ETL workflows, and ML model outputs
  • Conduct end-to-end testing across AI/ML lifecycle including data ingestion, training, inference, and deployment
  • Integrate automated test suites into CI/CD pipelines
  • Perform regression, integration, system, and performance testing
  • Identify, document, and track defects to closure
  • Collaborate with Data Engineers, ML Engineers, and DevOps teams
  • Ensure adherence to QA standards, best practices, and compliance requirements
  • Mentor junior QA team members when required
Required Skills
  • Software Quality Assurance
  • Test Planning and Test Strategy
  • Test Automation
  • Selenium
  • Pytest
  • Python
  • API Testing (REST)
  • CI/CD Integration
  • Data Pipeline Testing
  • AI/ML Pipeline Testing
  • Regression Testing
  • Defect Tracking
  • Git / Version Control
Preferred Skills
  • Machine Learning model validation (accuracy, drift, bias)
  • Cloud platforms (AWS, Azure, GCP)
  • Docker and Kubernetes
  • Performance and Load Testing
  • Data Quality and Monitoring frameworks

Top Skills

Api Testing
Ci/Cd
Docker
Git
Kubernetes
Pytest
Python
Selenium
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Andover, MA
324 Employees
Year Founded: 2007

What We Do

NorthBay is an AWS Premier Partner focused on Database & Application migrations, data & analytics, DevOps & DataOps, application modernization and ML/Ai.

Our practice areas include big data and analytics, machine learning, artificial intelligence and database migrations.

Similar Jobs

Motive Logo Motive

Senior Product Manager

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
Remote
India
4000 Employees

Sonar Logo Sonar

GSI Client Director - India

Artificial Intelligence • Cloud • Security • Software
Easy Apply
Remote or Hybrid
IND
800 Employees

Acquia Logo Acquia

Associate Cloud Operations Engineer ( Associate Cloud Operations Engineer (Linux Administration+ AWS + SQL+ Any Monitoring tools)

AdTech • Cloud • Marketing Tech • Productivity • Software • Analytics • Automation
Easy Apply
Remote or Hybrid
2 Locations
1100 Employees

BlackLine Logo BlackLine

Senior Site Reliability Engineer

Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Remote or Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
1810 Employees

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account