QA Automation Engineer - GenAI

Posted 9 Hours Ago
Hiring Remotely in United States
Remote
Senior level
Software • Database • Analytics
The Role
Design and execute test strategies and automation for cloud-native and GenAI/AI-ML systems. Perform functional, integration, performance, security, and API testing; validate model accuracy, fairness, robustness, and data quality; integrate automation into CI/CD; track defects; mentor junior QA engineers.
Summary Generated by Built In
QA Automation Engineer – GenAI

Location: Abu Dhabi
Experience: 7+ Years
Company: NorthBay Solutions

About NorthBay Solutions

NorthBay Solutions is a global digital transformation company delivering innovative cloud-native and AI/ML-powered solutions. We solve complex business challenges with a focus on modern technologies and real-world impact. At NorthBay, we promote a culture of excellence, ownership, and continuous learning.
Note: This is a full-time onsite role based in Abu Dhabi, UAE. Only UAE based candidates can apply.

Position Overview

We are hiring a QA Automation Engineer – GenAI with 7+ years of experience. This role demands a strong foundation in automation testing and a passion for quality across cloud-native, AI/ML, and GenAI platforms.

Key Responsibilities
  • Design and execute detailed test strategies, test plans, and test cases

  • Conduct functional, integration, performance, and security testing

  • Build and maintain automation frameworks using Pytest, Selenium, or similar tools

  • Perform thorough API testing using Postman or comparable tools

  • Collaborate with DevOps to integrate test automation in CI/CD pipelines

  • Validate AI/ML and GenAI solutions by:

    • Testing model accuracy, fairness, and performance

    • Detecting bias and validating robustness

    • Ensuring input/output data quality

  • Manage and track defects using tools such as JIRA

  • Provide mentorship to junior QA engineers and promote quality best practices

Required Qualifications
  • 7+ years of hands-on experience in QA and automation engineering

  • Proficiency with automation tools (e.g., Pytest, Selenium)

  • Strong skills in API testing

  • Knowledge of CI/CD integration

  • Solid understanding of software testing methodologies and lifecycle

  • Experience with functional and non-functional testing

  • Excellent communication and team collaboration skills

Preferred Skills
  • Experience testing AI/ML and GenAI systems, including:

    • Model validation and bias detection

    • Feature/data pipeline testing

    • Robustness and performance evaluation

  • Familiarity with cloud platforms (AWS, Azure, GCP)

Skills Required

  • 7+ years of hands-on experience in QA and automation engineering
  • Proficiency with automation tools (e.g., Pytest, Selenium)
  • Strong skills in API testing (Postman or comparable tools)
  • Knowledge of CI/CD integration
  • Solid understanding of software testing methodologies and lifecycle
  • Experience with functional and non-functional testing (performance, security)
  • Manage and track defects using tools such as JIRA
  • Excellent communication and team collaboration skills
  • Only UAE-based candidates can apply; willing to travel or relocate to Abu Dhabi
  • Experience testing AI/ML and GenAI systems (model validation, bias detection, robustness)
  • Familiarity with cloud platforms (AWS, Azure, GCP)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Andover, MA
324 Employees
Year Founded: 2007

What We Do

NorthBay is an AWS Premier Partner focused on Database & Application migrations, data & analytics, DevOps & DataOps, application modernization and ML/Ai. Our practice areas include big data and analytics, machine learning, artificial intelligence and database migrations.

Similar Jobs

Remote
US
820 Employees
In-Office or Remote
6 Locations
410 Employees

Push Operations Logo Push Operations

Quality Assurance Automation Engineer

HR Tech • Productivity • Software
In-Office or Remote
13 Locations
154 Employees
72K-88K Annually

Push Operations Logo Push Operations

Quality Assurance Automation Engineer

HR Tech • Productivity • Software
In-Office or Remote
2 Locations
154 Employees
72K-88K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account