The Role
Own end-to-end product quality from requirements review through release and production follow-up. Build and maintain Python-based Robot Framework and Playwright automation for UI, API, integration, and end-to-end testing. Validate backend data with SQL, integrate tests into CI/CD pipelines, investigate failures, and support defect root-cause analysis. Collaborate with product, engineering, and design teams while contributing to testing AI-enabled features, including LLM and RAG experiences.
Summary Generated by Built In
Our founding team has built successful companies together, created meaningful impact, and enjoyed
the journey enough to do it again. This is our most ambitious idea yet, and we see a long and
promising path ahead. We are Series A funded by a leading Silicon Valley VC.
If you are humble, compassionate, demonstrate integrity, operate with trust, and care deeply about
product quality, we would love to speak with you. We are Axiamatic!
About You
You have strong experience testing enterprise-grade web applications and SaaS products across
UI, API, and integration layers.
You have hands-on programming experience in Python and use it to build maintainable, reusable,
and reliable test automation.
You have practical experience developing API and UI automation using Robot Framework.
You have experience with Playwright for modern web application testing, preferably using Python.
You understand product requirements, user workflows, acceptance criteria, and business risks,
and translate them into effective test coverage.
You are comfortable combining automation with exploratory, functional, regression, integration,
and end-to-end product testing.
You investigate failures systematically, identify root causes, and communicate defects with clear
evidence and business impact.
You work closely with product management, engineering, and design to prevent defects and
improve overall product quality.
You are comfortable collaborating with globally distributed teams and taking ownership of quality
throughout the delivery lifecycle.
You are interested in learning, growing, and leading by example.
Requirements
Engineering graduate with 3-5 years of industry experience in software quality assurance and
product testing.
Strong hands-on programming and scripting experience in Python.
Experience designing and maintaining automated test suites using Robot Framework.
Experience automating REST API testing, including request validation, authentication, response
schemas, error handling, and data-driven scenarios.
Experience automating web UI workflows using Playwright and applying stable locator,
synchronization, and test-isolation practices.
Good understanding of test design techniques, test strategy, risk-based testing, defect lifecycle,
and release validation.
Experience testing end-to-end product workflows across frontend, backend services, databases,
and third-party integrations.
Working knowledge of SQL and relational databases such as PostgreSQL or MySQL for backend
data validation.
Experience with Git, CI/CD pipelines, automated test execution, and test reporting.
Familiarity with cloud-based or SaaS product environments and testing across multiple
deployment environments.
Ability to debug automation failures, application issues, network/API problems, and environment-
specific defects.
Strong communication skills and the ability to contribute effectively to engineering, product, and
release discussions.
Ability to work in a fast-paced environment with rapidly evolving business requirements.
A hands-off or 'not my job' attitude is an absolute no-go.
Preferred Experience
Experience evaluating applications powered by Large Language Models or Generative AI.
Understanding of Retrieval-Augmented Generation workflows, including retrieval, context
construction, prompt execution, and response validation.
Exposure to LLM and RAG quality metrics such as answer relevance, faithfulness or groundedness,
context precision and recall, answer correctness, hallucination rate, safety, latency, and cost.
Experience validating prompts, model responses, embeddings, vector search, citations, and AI-
agent workflows.
Startup or B2B SaaS product experience is a strong plus.
About What You'll Work On
Own quality activities for product features from requirement review and test planning through
release validation and production follow-up.
Design, develop, and maintain Python-based Robot Framework automation for API, UI,
integration, and end-to-end product workflows.
Build and enhance Playwright automation for reliable cross-browser testing of modern web
applications.
Perform functional, exploratory, regression, integration, and release testing for our B2B
Commerce platform.
Create reusable test libraries, data utilities, fixtures, and reporting capabilities that improve
automation scalability and maintainability.
Integrate automated tests into CI/CD pipelines and help establish effective quality gates, failure
triage, and release-readiness reporting.
Collaborate closely with product managers, developers, and team members in the US and India to
clarify requirements and deliver the product roadmap.
Contribute to testing AI-enabled capabilities, including LLM response quality and RAG-based
product experiences, where applicable.
Review defects and production issues, support root-cause analysis, and improve regression
coverage to prevent recurrence.
Maintain a strong focus on technical excellence, reliability, usability, customer impact, and
continuous quality improvement.
Skills Required
- Engineering degree
- 3-5 years of industry experience in software quality assurance and product testing
- Strong hands-on programming and scripting experience in Python
- Experience designing and maintaining automated test suites using Robot Framework
- Experience automating REST API testing, including validation, authentication, schemas, error handling, and data-driven scenarios
- Experience automating web UI workflows using Playwright
- Knowledge of test design, test strategy, risk-based testing, defect lifecycle, and release validation
- Experience testing end-to-end workflows across frontend, backend services, databases, and third-party integrations
- Working knowledge of SQL and relational databases such as PostgreSQL or MySQL
- Experience with Git, CI/CD pipelines, automated test execution, and test reporting
- Familiarity with cloud-based or SaaS product environments and multiple deployment environments
- Ability to debug automation failures, application issues, network/API problems, and environment-specific defects
- Strong communication and cross-functional collaboration skills
- Ability to work in a fast-paced environment with evolving requirements
- Experience evaluating LLM or Generative AI applications
- Understanding of Retrieval-Augmented Generation workflows
- Knowledge of LLM and RAG quality metrics
- Experience validating prompts, model responses, embeddings, vector search, citations, and AI-agent workflows
- Startup or B2B SaaS product experience
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Axiamatic develops an agentic control-plane platform for enterprise transformation. Its software continuously monitors complex programs, builds context from enterprise systems, identifies execution risks, requirements drift, and adoption gaps, and provides role-specific insights, recommendations, and proactive actions. The company serves large enterprises undertaking ERP modernizations, CRM rollouts, and other large-scale transformation initiatives, helping make these programs more predictable, visible, and successful.
