Software Development Engineer in Test - AI ML

Posted 2 Days Ago
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka, IND
Hybrid
150K-180K Annually
Senior level
Artificial Intelligence • Cloud • Events • Productivity • Software • Business Intelligence • Conversational AI
Trusted AI communications.
The Role
The Senior Software Development Engineer in Test will lead quality engineering for AI applications, focusing on automation frameworks, performance testing, and cross-functional collaboration with teams.
Summary Generated by Built In
Senior Software Development Engineer in Test (SDET 4) - AI & Agentic Platforms

Location: Bengaluru, India | Type: Full-Time | Team: Engineering

Reimagine How The World Communicates with AI

We are building the backbone for the next generation of human communication. Imagine a system that doesn't just transmit voice and video, but understands it in real-time, transcribing, summarizing and retrieving context across millions of concurrent sessions

We are seeking a Senior SDET (Level 4) to spearhead the quality engineering efforts for our next-generation AI and Agentic applications. In this role, you will go beyond traditional automation to build frameworks capable of validating Large Language Models (LLMs), autonomous agents, and complex platform integrations.

Key Responsibilities
  • AI & Agentic Strategy: Design and implement comprehensive test strategies for AI-driven features, focusing on model accuracy, hallucination detection, and the reliability of agentic workflows.

  • Framework Development: Build and maintain scalable automation frameworks using tools like Playwright, Selenium, and modern JS-based runners (e.g., Testcafe, Cypress) to support AI platform validation.

  • Infrastructure & CI/CD: Setup and maintain complex test environments, integrating automated AI evaluations into Jenkins/GitLab CI pipelines.

  • Advanced Testing: Lead R&D efforts to choose the best tools for performance, API, and scalability testing of AI microservices.

  • Technical Leadership: Conduct code reviews, establish coding standards, and provide technical guidance to the team on AI testing best practices.

  • Cross-functional Collaboration: Work closely with Architects, Data Scientists, and Product Managers to define "quality" in the context of non-deterministic AI outputs.

Required Qualifications
  • Experience: 10–15 years in software automation engineering.

  • Core Tools: Proven mastery of Playwright and Selenium.

  • AI Observability & Eval: Experience with LLM evaluation tools (e.g., LangSmith, Ragas, or Arize Phoenix) and model-based testing.

  • AI/ML Testing: Experience or deep knowledge in testing AI agents, LLM prompting, or data-driven systems.

  • Programming: High proficiency in Java, Python and JavaScript/TypeScript.

  • Frameworks: Mastery of PyTest, Jest, or Mocha for building modular, scalable test suites.

  • Environment Management: 3+ years of experience in test environment setup, maintenance, and CI/CD integration.

  • Testing Methodologies: Strong background in BDD (Cucumber/Behave), Data-Driven Testing, and Performance/Scalability testing.

Why You'll Love Working With Us

  • 🪐You’ll build things that scale globally

  • You’ll work on real problems; scale, efficiency, optimization.

  • You’ll be part of a global team collaborating with top engineers

  • Hybrid work from our Bengaluru office + flexible hours.

  • ❤ Full medical insurance for you and your family.

  • Competitive compensation + performance bonuses

RingCentral is an equal-opportunity employer that truly values diversity.

Top Skills

Gitlab Ci
Java
JavaScript
Jenkins
Jest
Mocha
Playwright
Pytest
Python
Selenium
Typescript
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Belmont , CA
7,000 Employees
Year Founded: 2003

What We Do

RingCentral is a global leader in AI-powered trusted business communications, contact center, revenue intelligence, video and hybrid event solutions. RingCentral empowers businesses with conversation intelligence and unlocks rich customer and employee interactions to provide insights and improved business outcomes.

Why Work With Us

Innovation isn't just a buzzword—it's the core and heart of everything we do. We believe that groundbreaking ideas emerge from every corner of our organization. Our biggest strength? We are not all the same. At RingCentral, our commitment to fostering a culture of curiosity and inclusivity is what sets us apart.

Gallery

Gallery

Similar Jobs

ServiceNow Logo ServiceNow

Product Manager

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
28000 Employees
100K-150K Annually

ServiceNow Logo ServiceNow

Product Manager

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
28000 Employees

TransUnion Logo TransUnion

Devops Engineer

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
13000 Employees

TransUnion Logo TransUnion

Process Capability Development Specialist

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Remote or Hybrid
3 Locations
13000 Employees

Similar Companies Hiring

Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account