This is a remote position.
Key Responsibilities
-
Evaluate AI agents for accuracy, consistency, and appropriate handling of edge cases and failures
-
Assess multi-step, multi-tool AI workflows to confirm agents behave as intended across an entire task, not just a single response
-
Conduct functional, regression, integration, and user acceptance testing across web and API layers
-
Identify, document, troubleshoot, finding root cause and track defects, working closely with the development team through to resolution
-
Maintain clear and thorough test documentation for both conventional features and AI-driven functionality
-
Support automation testing initiatives where relevant, or help establish them if they do not yet exist
-
Work with product and engineering teams to translate requirements into meaningful test coverage
Requirements
-
1–3 years of professional experience in quality assurance or software testing
-
Experience with automation testing tools such as Selenium, Playwright, or Cypress
-
Experience testing AI chatbots, AI Assistants, or agent AI systems
-
Solid grounding in QA fundamentals, including test case design and defect lifecycle management
-
Ability to test systems where outcomes are not always fixed or fully predictable
-
Strong written communication skills, particularly when explaining AI behavior to non-technical stakeholders
-
Ability to work independently and reliably in a remote setting
-
Familiarity with API testing tools such as Postman
-
Exposure to prompt evaluation or LLM output assessment methods
Skills Required
- 2-5 years of professional experience in quality assurance or software testing
- Practical experience testing Salesforce, including workflows, custom objects, or integrations
- Experience testing AI chatbots, conversational AI, or agent AI systems
- Knowledge of QA fundamentals, including test case design and defect lifecycle management
- Ability to test systems with non-fixed or unpredictable outcomes
- Strong written communication skills, particularly explaining AI behavior to non-technical stakeholders
- Ability to work independently and reliably in a remote setting
- Experience with automation testing tools such as Selenium, Playwright, or Cypress
- Familiarity with API testing tools such as Postman
- Exposure to prompt evaluation or LLM output assessment methods
- Relevant Salesforce certifications
What We Do
ConfidencEway is a Dubai-based AI-driven business solutions company helping organizations adopt practical, scalable, and affordable technology. Its offerings include generative and conversational AI, intelligent automation, machine vision, machine learning, AI agents, digital transformation, application modernization, web and mobile applications, managed cloud services, and the proprietary F2 Platform for building and managing enterprise AI solutions across global markets and sectors.
