SDET

Posted 22 Days Ago
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka, IND
In-Office
Mid level
Artificial Intelligence • Software • Automation
The Role
Design, build, and own automation frameworks, test utilities, and quality tooling for integrations and AI-driven agent workflows. Validate complex API and integration scenarios, implement CI/CD quality gates, investigate production issues using observability signals, and develop AI-powered validation systems to detect regressions and improve reliability across the product lifecycle.
Summary Generated by Built In
About Composio

At Composio, we are building infrastructure that allows agents to communicate with the tools you use for work including Github, Gmail, Notion, Salesforce, etc. We are a small team of engineers wrangling problems from context to search, that help us provide the most capable bridge between your agents and your tools.

We raised a $25M Series A from Lightspeed with some incredible angels like Guillermo Rauch (CEO of Vercel), Dharmesh Shah (CTO of Hubspot), Gokul Rajaram. Beginning of this year we 3x'd our ARR, our customers range from your friends in the YC batch to Wabi, Glean, Zoom and many more.

What You'll Work On
  • Build Automation Frameworks & Testing Infrastructure – Design, develop, and own automation frameworks, reusable test utilities, and quality tooling that enable scalable testing, validation, and release confidence across Composio's integrations, connectors, and agent workflows.

  • Validate Complex Integration Workflows – Design and execute test scenarios for critical integration workflows across internal and external systems, covering APIs, contracts, compatibility, authentication, webhooks, retries, idempotency, asynchronous workflows, and third-party dependencies. Identify edge cases and ensure reliable system behavior.

  • Enable Automation-Driven Quality Signoff – Build and maintain automated test suites, quality gates, and CI/CD checks that provide release confidence through functional, API, integration, contract, and regression testing. Analyse quality signals and engineering metrics to identify risks, prevent regressions, and support data-driven release decisions.

  • Build AI-Powered Quality Systems – Build AI-powered validation systems, agents, and automated workflows that help validate integrations, detect regressions, investigate failures, and scale quality across rapidly evolving products.

  • Improve Testing Strategy & Quality Practices – Contribute to testing approaches across integration, API, contract, and end-to-end layers. Improve test coverage, establish effective testing patterns, and strengthen validation practices across the engineering lifecycle.

  • Improve Reliability of AI-Native Products – Develop testing and evaluation approaches for AI-powered workflows, tool-calling agents, and other systems where outputs may vary between executions. Help measure quality, identify gaps, and improve confidence in AI-driven experiences.

  • Improve Production Quality & Reliability – Investigate production issues, contribute to root-cause analysis, enhance test observability, and implement preventive improvements that increase system reliability and platform stability.

  • Raise the Engineering Quality Bar – Partner with engineers to improve testability, provide input on design decisions, apply quality best practices, and help teams build reliable, testable systems.

Must HavesAutomation & Quality Engineering
  • You build automation frameworks, quality platforms, and developer tooling that engineers rely on.

  • You write clean, maintainable automation and validation code, and understand how to apply the right quality strategy across API, integration, contract, and end-to-end layers.

  • You care about quality outcomes, CI/CD quality gates, release confidence, and reducing flaky tests—not just test execution.

Complex Systems & Integrations
  • You can reason about API behavior, authentication, retries, idempotency, eventual consistency, and distributed systems.

  • You have experience testing, validating, and debugging integration-heavy systems involving multiple services and external dependencies.

  • You use logs, traces, metrics, and production signals to investigate failures and improve system reliability.

AI-Native
  • You actively use AI to accelerate testing, debugging, automation, or engineering workflows—with validation and critical thinking, not blind trust.

  • You understand AI agents, MCP/tool-calling systems, and LLM-powered workflows, and can think about evaluating and validating non-deterministic systems.

Product Judgement
  • You make risk-based engineering decisions by balancing customer impact, reliability, delivery speed, and validation depth.

  • You understand user workflows and business impact, prioritize the highest-risk areas, and focus engineering effort where it creates the most customer confidence.

Ownership & Collaboration
  • You take ownership of issues, drive them to resolution, and continuously improve quality outcomes.

  • You communicate clearly, explain technical trade-offs, and collaborate effectively across engineering teams.

  • You proactively learn, seek context, and independently solve ambiguous problems in a fast-moving environment.

Skills Required

  • Build and maintain automation frameworks and developer tooling for testing
  • Write clean, maintainable automation and validation code across API, integration, contract, and end-to-end layers
  • Design and execute tests for integrations covering authentication, retries, idempotency, webhooks, and asynchronous workflows
  • Implement automated test suites, quality gates, and CI/CD checks to ensure release confidence
  • Use logs, traces, and metrics to investigate failures and improve system reliability
  • Experience testing and validating integration-heavy systems with third-party dependencies
  • Experience applying risk-based testing and product judgment to prioritize validation effort
  • Experience building or applying AI/LLM-based systems to accelerate testing, validation, or debugging
  • Ability to evaluate and validate non-deterministic AI/agent outputs
  • Collaborate with engineers to improve testability, design, and quality practices
  • Ownership mindset: drive issues to resolution and improve quality outcomes
  • Clear communication of technical trade-offs across engineering teams
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dover, DE
64 Employees
Year Founded: 2023

What We Do

At Composio, We're building the future of Agentic Actions. We are empowering AI Agents to interact with hundreds of applications/tools and take autonomous actions, streamlining workflows and unlocking new possibilities. We're always on a lookout for great talent and check out our careers page!

Similar Jobs

CloudSEK Logo CloudSEK

SDET II

Artificial Intelligence • Software
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
162 Employees

Applied Systems Logo Applied Systems

SDET

Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
3079 Employees

Applied Systems Logo Applied Systems

Sr SDET

Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
3079 Employees

Weekday, Inc. Logo Weekday, Inc.

Quality Assurance Automation Engineer

Artificial Intelligence • HR Tech • Professional Services • Software
In-Office
4 Locations
2M-3M Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account