Bilingual QA Automation Engineer - AI/IVR

This is a remote position.

About the Job: The QA Engineer is responsible for end-to-end test coverage across manual and AI-driven automated testing. This role requires the ability to design and execute traditional manual test cases as well as build and prompt AI agents to autonomously generate and execute test cases, making AI-based test automation a mandatory, hands-on skill rather than a nice-to-have.

Office Location: Toronto

Employment Type: Permanent

Role Type: New position – current requirement

Work Arrangement: Hybrid (2 days in office)/Remote

Position Responsibilities:

•      Analyze requirements/user stories and design comprehensive manual test cases (functional, regression, integration, UAT, edge cases).

•      Execute manual test cases, log results, and track defects through resolution.

•      Design and configure AI agents (e.g., via prompt engineering / agentic AI test tools) to autonomously generate test cases from requirements or application context.

•      Prompt and direct AI agents to execute generated test cases, validate outcomes, and interpret AI-produced results.

•      Continuously refine prompts/agent configurations to improve accuracy, coverage, and reliability of AI-generated tests.

•      Perform regression testing (manual and AI-assisted) to ensure new releases don’t break existing functionality.

•      Maintain traceability between requirements, test cases, and defects.

•      Log, triage, and track defects in tools such as JIRA/Azure DevOps; work with developers to verify fixes.

•      Prepare test summary reports, coverage metrics, and quality sign-off documentation for releases.

•      Collaborate with developers, product owners, and DevOps to align testing with release/deployment schedules.

•      Evaluate and recommend AI testing tools/frameworks to expand automation coverage over time.

•      On-call/off-hours testing flexibility — IVR changes often deploy during low-traffic windows (nights/weekends)

Required Qualifications:

•      5–7 years of hands-on QA experience with hands-on experience creating and prompting AI agents to generate and execute test cases (AI-driven test automation).

•      Must be proficient in Java, node JS, automation frameworks and Test Design Patterns (Page Object Model, Factory, Singleton, BDD)

•      Strong manual testing fundamentals: test plan/test case design, exploratory testing, bug reporting.

•      IVR/telephony testing experience — testing call flows, voice menus, DTMF (touch-tone) input, call routing, transfers, hold/voicemail scenarios.

•      Familiarity with IVR/telephony platforms — e.g., Avaya, Genesys, Nuance, Twilio, Five9, NICE inContact (pick whichever your stack actually uses).

•      Conversational fluency in French (spoken) — testers must be able to interact directly with the French-language voice bot (IVR) and chat bot to validate prompts, natural language understanding, call/chat flows, and response accuracy. French is mainly required for live interaction/testing purposes.

•      Understanding of prompt engineering concepts as applied to test generation and execution workflows.

•      Familiarity with defect tracking and test management tools (JIRA, Azure DevOps, TestRail, or similar).

•      Working knowledge of SDLC/Agile methodologies.

•      Basic SQL skills for data validation.

•      Ability to read logs/API responses to validate results from AI-executed tests.

Preferred Qualifications:

•      Experience with traditional automation frameworks (Selenium, Playwright, Cypress)

•      Exposure to API testing (Postman, REST Assured).

•      Experience testing applications deployed on GCP (or any cloud , GCP is preference)

•      ISTQB or equivalent QA certification.

Salary Range: $85,000 to $90,000 CAD/ year

The final compensation offered will depend on local market conditions and geographic location, as well as job-related factors such as the candidate’s knowledge, skills, qualifications, relevant experience, and education/training. Compensation may also include additional components such as benefits, and/or other incentives, where applicable. In accordance with new employment standards requirements, we retain copies of this job posting and applicant information for three (3) years after the posting is removed. We do not use AI technology; all applications are also reviewed by our recruitment team.

Infoya is an equal opportunity employer committed to diversity and inclusion. We welcome applications from all qualified individuals, regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status, aboriginal status, or any other legally protected factors.