Senior QA Engineer – AI Platform Testing

Job Title: QA Engineer – AI Platform Testing
Location: Pakistan (Karachi - Lahore - Islamabad) (Willing to Travel Frequently or Relocate to Abu Dhabi)
Experience: 5+ Years
Company: NorthBay Solutions

About the Role:
NorthBay Solutions is looking for a QA Engineer with strong automation skills to support testing efforts across our AI-driven platforms. In this role, you will ensure the functional accuracy, performance, and quality of features while also contributing to validation of AI model outputs, training data quality, and overall user experience across web and API-based systems.

Key Responsibilities:

• Design, write, and execute test cases to validate features, APIs, and end-to-end system integrations.

• Develop and maintain automated test scripts using Java-based frameworks (e.g., Selenium, TestNG, or similar).

• Conduct manual and exploratory testing for AI model outputs and user workflows.

• Validate training datasets, detect anomalies, and evaluate model-generated content.

• Log and track defects with comprehensive documentation using bug tracking tools.

• Collaborate closely with Machine Learning, Development, and Automation teams to define test strategies and acceptance criteria.

• Contribute to regression testing cycles and final release validations.

Required Skills & Qualifications:

• 5+ years of professional experience in QA or software testing.

• Proven experience in QA automation using Java.

• Solid understanding of Agile methodologies, QA processes, and test lifecycle management.

• Hands-on experience with test management tools (TestRail, Zephyr) and defect tracking tools (JIRA, Azure DevOps).

• Strong experience with API testing tools such as Postman.

• Excellent analytical skills and attention to detail.

• Preferred (Nice to Have):

  • Exposure to AI/ML concepts, particularly around testing LLM outputs, computer vision, or NLP systems.

  • Experience validating training data quality and evaluating model behavior in production environments.

About NorthBay Solutions:
NorthBay Solutions is a leading cloud-native and AI-focused digital transformation company. We specialize in helping enterprises modernize their applications and data ecosystems to accelerate innovation and business growth.