Senior Software Engineer in Test

Posted 2 Days Ago
Be an Early Applicant
Chennai, Tamil Nadu, IND
In-Office
Senior level
Software
The Role
Own quality for Rocketlane’s core SaaS platform and GenAI features through functional testing, UI and API automation, distributed-systems testing, performance testing, and AI-agent evaluations. Build Playwright suites in TypeScript, test asynchronous workflows and service contracts, integrate automation into CI/CD, document strategies, and provide release sign-off. The role also involves evaluating hallucinations, tool misuse, non-deterministic outputs, and human handoffs.
Summary Generated by Built In
About Rocketlane

Rocketlane is a B2B SaaS platform for client onboarding and project delivery. Our product runs on a set of microservices that power projects, resourcing, time tracking, billing and a customer-facing portal. We're also building Nitro, an AI-native layer where Nitro agents do real delivery work for our customers.

We're hiring a Senior Software Engineer in Test who can test both: the core platform, and the GenAI and agentic features we build on top of it.

This is not a "run the regression suite and file tickets" role. You'll own quality for the areas you cover, from functional testing to automation to release sign-off.

What you'll own
  • Functional testing: Understand features end to end, from requirements to edge cases. Write test plans and test cases, and run exploratory testing before every release.

  • UI and end-to-end automation: Build and maintain Playwright suites in TypeScript for critical user journeys. Keep them fast, stable and free of flaky tests.

  • API and microservices testing: Test REST APIs and the contracts between services. Cover authentication, permissions, data validation and error handling.

  • Distributed systems testing: Test asynchronous flows, background jobs and event-driven workflows across services. Check for data consistency, retries, idempotency and behaviour when a downstream service fails or slows down.

  • Performance and reliability: Run load and performance tests on key services and workflows. Find bottlenecks before customers do.

  • GenAI and agentic testing: Test Nitro agents and other GenAI features for accuracy, consistency and safe behaviour. Build eval suites, curate test datasets from real scenarios, and check tool-use accuracy and handoff to humans.

  • CI/CD and release quality: Wire automated suites into CI so every change is checked before it ships. Provide quality sign-off for the areas you cover.

  • Frameworks and documentation: Enhance our existing test frameworks and tools. Document test strategies, test cases and guidelines for the team.

Requirements
  • 4–7 years in software testing and test automation for web applications

  • Strong programming skills in TypeScript, Java or Python for test automation

  • Solid programming fundamentals: data structures, algorithms and object-oriented design, applied to writing clean, maintainable test code

  • Hands-on experience with Playwright or Selenium for UI and end-to-end testing, including building and maintaining a framework

  • Strong functional testing skills: breaking down requirements, writing test cases and finding edge cases

  • Experience testing REST APIs and microservices, including service-to-service contracts

  • A good understanding of distributed systems: async processing, queues or events, eventual consistency and partial failures, and how to test for them

  • Exposure to testing GenAI or agentic features, and an understanding of how they fail (hallucination, non-deterministic output, tool misuse)

  • CI/CD experience (GitHub Actions or similar)

  • Daily use of AI coding agents, and the judgement to review the test code they write

  • Excellent written communication: bug reports an engineer can act on without a meeting

Nice to have
  • Experience with an LLM eval framework (such as DeepEval, Promptfoo or RAGAS)

  • Load testing experience (k6, Locust or similar)

  • Security testing experience, including for AI applications

Why this role

You'll join a team that already tests and automates our platform and AI features, and help raise the bar as both grow. You'll work across the full product: core workflows, the services behind them, and the Nitro agents built on top. You'll work directly with the engineers and PMs building them, and your quality sign-off is a key input to every release. If you want to grow from strong product testing into AI testing, this role is for you.

Skills Required

  • 4–7 years of experience in software testing and test automation for web applications
  • Strong programming skills in TypeScript, Java, or Python for test automation
  • Knowledge of data structures, algorithms, and object-oriented design applied to test code
  • Hands-on experience with Playwright or Selenium for UI and end-to-end testing
  • Strong functional testing skills, including test case design and edge-case discovery
  • Experience testing REST APIs and microservices, including service-to-service contracts
  • Understanding of distributed systems, asynchronous processing, queues, events, eventual consistency, and partial failures
  • Exposure to testing GenAI or agentic features
  • CI/CD experience, such as GitHub Actions
  • Daily use of AI coding agents and ability to review generated test code
  • Excellent written communication for actionable bug reports
  • Experience with an LLM evaluation framework such as DeepEval, Promptfoo, or RAGAS
  • Load testing experience with k6, Locust, or similar tools
  • Security testing experience, including AI application security
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Walnut, CA

Similar Jobs

Remote or Hybrid
India
43 Employees

Comcast Logo Comcast

Network Engineer

Digital Media • Information Technology • News + Entertainment
Hybrid
Chennai, Tamil Nadu, IND
115000 Employees

Comcast Logo Comcast

Network Engineer

Digital Media • Information Technology • News + Entertainment
Hybrid
Chennai, Tamil Nadu, IND
115000 Employees

Comcast Logo Comcast

Network Engineer

Digital Media • Information Technology • News + Entertainment
Hybrid
Chennai, Tamil Nadu, IND
115000 Employees

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account