Senior Engineer I - QA

Posted 2 Days Ago
Be an Early Applicant
Pune, Mahārāshtra, IND
In-Office
Senior level
Software
The Role
Own quality strategy and automation for APIs, SDKs, CLIs, developer tools, marketplace apps, and AI integrations. Build CI-integrated regression suites, conduct exploratory and compatibility testing, and drive defects to closure. Use AI-assisted workflows for test generation, test data, triage, and review. Develop testing approaches for LLM and agentic features, including MCP tool behavior, prompt and response evaluation, non-deterministic outputs, and regression baselines.
Summary Generated by Built In

What is Contentstack?

Contentstack is redefining how modern digital experiences are built and managed. As the pioneer of the Agentic Experience Platform (AXP), Contentstack brings together structured content and brand governance (Content Cloud), real-time customer data, omnichannel personalization (Data Cloud) and autonomous AI orchestration (Agent OS) into one unified system.

While many organizations adopted headless CMS or standalone AI tools expecting transformation, they often found themselves managing disconnected systems and manual workflows. Contentstack helps enterprises move beyond that complexity by connecting content, data and AI in a way that makes digital experiences faster to launch, easier to manage and more adaptive in real time.

Leading brands including Steve Madden, LG Electronics, Subaru of America, Dolce & Gabbana, ASICS, Decathlon, and Caesars Entertainment rely on Contentstack to reduce operational friction and deliver personalized, scalable digital experiences with confidence. The company is known for its customer-first culture and commitment to the communities it serves through the Contentstack Cares program.

Learn more at www.contentstack.com.

Who Are We?

At Contentstack we are more than colleagues, we are a tribe. Our vision is to pursue equity among our communities, employees, partners, and customers. We are global-diverse yet close; distributed yet connected. We are dreamers and dreammakers who challenge the status quo. We do the right thing, even when no one is watching. We are curious trendspotters and brave trendsetters. Our mission is to make Contentstack indispensable for organizations to tell their stories and to connect with the people they care about through inspiring, modern experiences. We care deeply about our customers and the communities we serve. #OneTeamOneDream. Chalo, let’s go!

Senior Engineer I - QA

Location: Pune

Experience: 5-8 Years

What you will be working on:

Developer Ecosystem Quality

  • We are looking for an automation-focused Senior QA Engineer to own quality for the Developer Ecosystem (SDKs, APIs, CLI, developer tooling, marketplace apps and AI-facing integrations such as MCP servers and agent tooling).
  • The role should both use AI to raise QA throughput and know how to test AI-powered features.

Roles & Responsibilities

Test Strategy and Automation

  • Own the test strategy and automation frameworks for APIs, SDKs and CLI across supported languages.
  • Build and maintain CI-integrated regression suites and release-readiness checks.
  • Run exploratory and compatibility testing for developer-facing releases.

AI-Assisted QA and AI Feature Testing

  • Use AI-assisted workflows (LLM-based test generation, test data creation, failure triage, code review of tests) to speed up coverage while validating the output.
  • Design test approaches for AI-powered and agentic features, including MCP tool behavior, prompt and response evaluation, non-deterministic output checks, and regression baselines for model or prompt changes.

Collaboration

  • Partner with engineering, product and DevRel to catch issues early and improve developer experience.
  • Triage and drive defects to closure and report on quality metrics.

Mandatory Skills

  • 5-8 years in QA/SDET with strong API automation (REST/GraphQL).
  • Proficiency in JavaScript/TypeScript or Python for test automation.
  • Hands-on with CI/CD pipelines and frameworks such as Jest, Mocha, Playwright or pytest.
  • Practical experience using AI coding and testing assistants in day-to-day QA work.
  • Experience testing SDKs, CLIs or developer platforms is a strong plus.

Preferred Skills

  • Exposure to testing LLM or agent-based systems, evals, MCP or similar tool-calling interfaces, and AI-assisted test automation approaches.

What Do We Offer?

Interesting Work | We hire curious trendspotters and brave trendsetters. This is NOT your boring, routine, cushy, rest-and-vest corporate job. This is the “challenge yourself” role where you learn something new every day, never stop growing, and have fun while you’re doing it. 

Tribe Vibe | We are more than colleagues, we are a tribe. We have a strict “no a**hole policy” and enforce it diligently. This means we spend time together - with spontaneous office happy hours, organized outings, and community volunteer opportunities. We are a diverse and distributed team, but we like to stay connected.

Bragging Rights | We are dreamers and dream makers. Our efforts pay off and we work with the most prestigious brands, from big-name retailers to airlines, to professional sports teams. Your contribution will make an impact with many of the most recognizable names in almost every industry including AirFrance KLM, ASICS, Burberry, Mattel, Mitsubishi, Walmart, and many more!

One Team One Dream | This is one of our values, and it shows. We don’t believe in artificial hierarchies. If you’re part of the tribe, you have an opportunity to contribute. Your voice will be heard and you will also receive regular updates about the business and its performance. Which, btw, is through the roof, so it’s a great time to be joining…


To review our Privacy Policy, please click here.

Skills Required

  • 5-8 years of experience in QA or SDET with strong REST and GraphQL API automation
  • Proficiency in JavaScript, TypeScript, or Python for test automation
  • Hands-on experience with CI/CD pipelines and testing frameworks such as Jest, Mocha, Playwright, or pytest
  • Practical experience using AI coding and testing assistants in day-to-day QA work
  • Experience testing SDKs, CLIs, or developer platforms
  • Exposure to testing LLM or agent-based systems, evals, MCP, or similar tool-calling interfaces
  • Experience with AI-assisted test automation approaches
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Austin, TX
523 Employees
Year Founded: 2018

What We Do

Contentstack is a composable DXP which is a digital experience platform assembled from a series of best-of-breed solutions. These solutions work together via APIs to deliver content and digital experiences to customers in a more agile and flexible way than a single, integrated, and essentially monolithic platform. It brings a microservices approach to the DXP space. Our composable DXP stands out in the market, so your digital experiences can. The Contentstack platform builds on our pioneering headless CMS roots, making complete what headless CMS alone do not. This includes a built-in Marketplace, full-stack automation, and integrated front-end hosting for full end-to-end digital experience functionality. Unlike legacy DXP solutions, we do this with a 100% open MACH architecture for maximum choice and functionality up and down the composable stack. There is no stack like Contentstack. Learn more at www.contentstack.com.

Similar Jobs

Capco Logo Capco

Ledger SME

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

TransUnion Logo TransUnion

Analyst, Global Delivery

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
2 Locations
13000 Employees

Capco Logo Capco

BA Regulatory Reporting - GCB5

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

TransUnion Logo TransUnion

Consultant

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
2 Locations
13000 Employees

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account