We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work on a scale across all devices and digital mediums, and our people exist everywhere in the world (17000 plus experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!
Job DescriptionRole - Senior QA Automation Tester
Location - Evanston, Illinois USA
Work Model - Onsite - Hybrid (3 days a week work from office)
Employment type - Full-time
Job Overview:
- Role Summary We are looking for an Application Tester / QA Engineer who can ensure the quality, reliability, and correctness of web applications, mobile and Gen AI-enabled systems.
- The role requires a strong analytical mindset, hands-on experience with automated testing frameworks, features.
What You’ll Do Web & UI Testing:
- Test UI workflows using Selenium, Cypress, or Playwright.
- Validate cross-browser behaviour, UI responsiveness, and user interaction flows.
- Identify UI edge cases, broken states, and usability issues. GenAI / NLP Output Validation
- Test NLP and GenAI-powered features, including o Chat-based interfaces o Text generation, summarization, and extraction outputs
- Validate LLM outputs for: o Functional correctness o Format and schema adherence o Edge cases and failure scenarios
- Design test cases for non-deterministic outputs, including prompt variations and response consistency.
- Identify hallucinations, incorrect grounding, and unsafe responses where applicable.
Defect Tracking & QA Governance:
- Document defects clearly with reproducible steps, expected vs actual results, and logs.
- Maintain test plans, test cases, and QA reports.
- Support QA governance through structured documentation and reporting.
- Track test coverage and quality metrics across releases.
Must have skills:
- Minimum 7 years of experience as a QA Automation.
- AI testing exposure, API Testing (Capable), Playwright with Java, Python (Strong)
- Experience testing web applications and mobile testing.
- Hands-on experience with Postman for API validation.
- Familiarity with Selenium for UI automation.
- Strong analytical skills for identifying edge cases and failure scenarios.
- Ability to write clear, structured test documentation and defect reports.
- Ability to write clear, structured test documentation and defect reports.
Nice-to-Have Skills:
- Experience testing NLP or GenAI-based applications.
- Familiarity with validating LLM outputs, prompts, and structured responses.
- Experience with CI/CD-integrated testing.
- Exposure to performance or load testing tools.
- Understanding of basic database validation for test verification.
Disclaimer: Nagarro is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will be afforded equal employment opportunities without discrimination based on race, creed, color, national origin, sex, age, disability, or marital status.
Top Skills
What We Do
Nagarro helps future-proof your business through a forward-thinking, fluidic, and CARING mindset. We excel at digital engineering and help our clients become human-centric, digital-first organizations, augmenting their ability to be responsive, efficient, intimate, creative, and sustainable. Today, we are 19,000 experts across 36 countries, forming a Nation of Nagarrians, ready to help our customers succeed.
.png){kind=logo}
