Senior QA Engineer - Implementation

Posted 2 Days Ago
Be an Early Applicant
Gurugram, Haryana, IND
In-Office
Senior level
Artificial Intelligence • HR Tech • Software
The Role
Test enterprise HR integrations and AI-powered chat and voice assistants using automation, manual, and API testing. Design comprehensive test cases, investigate failures, validate REST APIs, manage defects, and collaborate with developers and clients. Build and maintain Playwright-based automation, run tests through CI/CD pipelines, assess AI responses and conversations, and evaluate risks such as prompt injection, data leaks, and PII handling. The role is full-time, in-office in Gurgaon, with shift flexibility required for client time-zone coverage.
Summary Generated by Built In

About Leena AI

Leena AI is a leader in Agentic AI for the enterprise. We are building an iconic company, delivering AI Colleagues that transform back-office functions and accelerate the full promise of Generative AI - unlocking real productivity gains, cutting costs, and delighting employees at scale.

Leena AI provides the most forward-looking, open, and scalable Agentic AI architecture for the enterprise - it empowers CIOs and CTOs to develop, deploy, and manage AI Colleagues for the back office at scale. Built with full governance, compliance, security, and auditability at its core.

Leena AI integrates with 1000+ applications, including SAP, Salesforce, ServiceNow, Workday, and Microsoft Office 365. We are proud to be trusted by 500+ global enterprises and 20 million+ employees, including leading brands such as Nestlé, Puma, Coca-Cola, Sony, and Etihad Airways.

Founded in 2018 and headquartered in New York, Leena AI has secured over $40M in financing from top-tier investors including Greycroft, Bessemer Venture Partners, B Capital, and Y Combinator.

Role Overview :
We are looking for a QA Engineer with 5+ years of experience who is good at automation, manual, and API testing, and is comfortable talking to clients directly. You'll be testing HR system integrations and AI-powered chat and voice assistants for enterprise customers — so solid QA basics plus some comfort with AI products will help a lot.

This is a full-time, in-office role based in Gurgaon (5 days a week).


Requirements

Must-Have Skills

Automation Testing

  • At least 2 years of hands-on automation testing experience.
  • Playwright is a strong preference (Selenium or similar tools also considered, but you should be ready to work on Playwright)
  • Good coding in JavaScript, TypeScript, or Java
  • Can run tests through CI/CD pipelines (Jenkins, GitHub Actions, GitLab CI, or similar)
  • Comfortable with Git — branches, pull requests, code reviews
  • Can look at a failed test and tell whether the app is broken or the script is broken

Manual & API Testing

  • Can read a requirement and plan out how to test it, without being told every step
  • Writes clear, well-organised test cases — happy path, negative cases, boundary and edge cases
  • When requirements are unclear, asks the right questions and points out what's missing
  • Hands-on with REST APIs — checking requests and responses, status codes, headers, authentication, JSON
  • Can think of useful API test scenarios, not just fire requests and see what comes back

Client Handling & Communication

  • Has worked directly with clients or external stakeholders before
  • Clear and confident in both writing and speaking
  • Can explain an issue to a developer and also to a non-technical client, in the right language for each

Problem Solving

  • Digs into why something failed, not just that it failed

Shift Flexibility

  • Willing to work in shifts to overlap with client time zones, as per project needs

Good to Have

  • AI / Chatbot Testing
  • Has tested chatbots, voice bots, or AI-based features before
  • Understands that AI answers change every time, so a plain "expected vs actual" match won't work — and has some idea of how to test that
  • Testing full conversations, not single messages — does the bot remember context, handle a topic change, fall back properly, hand over to a human when needed
  • For bots that answer from documents — can tell if the bot picked the wrong document, or picked the right one and still gave a wrong answer
  • Basic awareness of AI risks — prompt injection, data leaks, PII handling
  • Has used or is willing to learn LLM testing tools (DeepEval, Ragas, Promptfoo, Giskard)
    Can read basic Python (most of these tools are Python-based)
  • TestNG / JUnit
  • Jira or any similar bug tracking tool
  • Using AI assistants like Claude or ChatGPT to work faster on testing and automation

Skills Required

  • At least 5 years of QA engineering experience
  • At least 2 years of hands-on automation testing experience
  • Experience with Playwright, or Selenium or similar automation tools with willingness to learn Playwright
  • Good coding skills in JavaScript, TypeScript, or Java
  • Ability to run tests through CI/CD pipelines such as Jenkins, GitHub Actions, or GitLab CI
  • Comfort with Git, including branches, pull requests, and code reviews
  • Ability to distinguish application defects from broken test scripts
  • Ability to independently plan testing from requirements
  • Ability to write organized happy-path, negative, boundary, and edge-case test cases
  • Hands-on REST API testing, including requests, responses, status codes, headers, authentication, and JSON
  • Experience working directly with clients or external stakeholders
  • Clear written and verbal communication with technical and non-technical audiences
  • Strong problem-solving and failure investigation skills
  • Willingness to work shifts to overlap with client time zones
  • AI, chatbot, voice bot, or AI feature testing experience
  • Understanding of conversational AI testing, including context, topic changes, fallback, and human handoff
  • Experience evaluating retrieval-augmented answers and document selection
  • Basic awareness of prompt injection, data leaks, and PII handling
  • Experience with or willingness to learn DeepEval, Ragas, Promptfoo, or Giskard
  • Ability to read basic Python
  • Experience with TestNG or JUnit
  • Experience with Jira or a similar bug tracking tool
  • Use of AI assistants such as Claude or ChatGPT for testing and automation
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Wilmington, Delaware
257 Employees
Year Founded: 2015

What We Do

Leena AI is an autonomous conversational AI-backed platform that helps enterprises better employee experience. The platform is powerful, flexible, and made to meet the needs of any enterprise. With Leena AI, companies can eliminate the need for HR staff to work on tasks such as answering policy-related questions, knowledge management, generating employee documents on demand, and managing employee tickets so they can focus on high-value activities. Leena AI plays well with 20 plus platforms, including SAP SuccessFactors, ADP, Oracle, Workday, and Microsoft Office 365. It is trusted by 1M employees across companies like Nestle, Puma, AirAsia, Coca-cola, Lafarge Holcim, and Abbott. The platform is capable of handling every aspect of employee experience across the employee lifecycle. From FAQ automation and employee engagement right up to employee onboarding, the platform aims to help organizations streamline all HR workflows.

Similar Jobs

BlackRock Logo BlackRock

Associate, Cyber Observability

Fintech • Information Technology • Financial Services
In-Office
Gurugram, Haryana, IND
25000 Employees

BlackRock Logo BlackRock

Vice President. Cyber Observability

Fintech • Information Technology • Financial Services
In-Office
Gurugram, Haryana, IND
25000 Employees

CrowdStrike Logo CrowdStrike

Senior Android Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
India
11000 Employees

Expedia Group Logo Expedia Group

Product Manager

AdTech • eCommerce • Information Technology • Software • Travel • Generative AI
Hybrid
Gurugram, Haryana, IND
16000 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account