QA Automation Engineer

Posted 15 Days Ago
Be an Early Applicant
Medellín, Antioquia, COL
In-Office
Mid level
Professional Services • Software • Business Intelligence • Consulting
The Role
Build and own the quality practice for a partner portal, including test strategy, API contract testing, Playwright or Cypress UI automation, authentication and billing-flow testing, CI/CD integration, and release quality gates. Partner with product and engineering teams to create testable scenarios. Evaluate and operationalize AI-assisted test generation, data creation, failure triage, and workflow standards while maintaining privacy and quality guardrails.
Summary Generated by Built In
QA Automation Engineer, MSP Partner Portal 

About the client
Our client is a leading global email and collaboration security company. It is building a new engineering team in Medellín to own its partner portal for Managed Service Providers (MSPs): the platform partners use for quoting, contracts, billing and provisioning.

About the role
We are hiring QA Automation Engineers at Senior and Mid level for this new team, which will take over the MSP partner portal from the systems integrator that runs it today, operate it in production and shape its roadmap. You will build the portal's quality practice from scratch, with AI-assisted testing at its core. You will report to the Director of QA and work daily with colleagues in the United States and India.

The stack is a React microfrontend shell in an NX monorepo and a TypeScript/Node backend-for-frontend over microservices on AWS EKS, with Keycloak for identity and integrations with Salesforce Revenue Cloud, Boomi, NetSuite, ZoneBilling, Snowflake and Avalara.

What you'll do
• Build the portal's test strategy from scratch: test pyramid, environments, test data, quality gates and reporting.
• Implement API contract testing against the OpenAPI specifications for the BFF, microservices and partner APIs.
• Build end-to-end UI automation with Playwright or Cypress across the React microfrontends.
• Automate end-to-end tests of critical flows: SAML-to-OIDC authentication, and quoting, contract and usage-based billing flows.
• Integrate automated tests into CI/CD pipelines across Dev, QA, Staging and Production.
• Work with the Product Owner to turn acceptance criteria into testable scenarios, and with engineers to make quality a shared responsibility.
• Evaluate, pilot and roll out AI testing tools such as Claude, Cursor and GitHub Copilot (and others like Playwright AI/MCP agents, Mabl or Applitools), measuring their impact on authoring time, coverage and defect leakage.
• Use AI to generate and maintain Playwright/Cypress and contract tests from OpenAPI specs and acceptance criteria, create test data, and summarize and triage CI failures.
• Set up shared AI ways of working: reusable prompts and Cursor rules, review standards for AI-generated tests and data-privacy guardrails.

Level expectations
• Senior (typically 7+ years): designs and owns the test strategy and frameworks, leads quality during the platform handover and coaches engineers on testing.
• Mid (typically 2–7 years): extends the automation suites and covers new features within the strategy, joining after go-live.

What success looks like in your first 6 months
• Knowledge transfer complete for existing tests, environments and known defects.
• A documented test strategy, with automated contract and end-to-end tests running in CI for the critical authentication and billing flows.
• The team owning release quality, with clear release gates and regression coverage.
• Frameworks, test data and environments documented so others can run and extend them.
• AI-assisted test generation and triage in regular use, with measured time savings and documented guardrails.

Tech environment
Playwright • Cypress • TypeScript / JavaScript • API contract testing (Pact, OpenAPI) • CI/CD • OIDC / SAML / JWT • Claude • Cursor • GitHub Copilot

Requirements
Required
• Professional experience in test automation for web applications and APIs.
• Hands-on experience with Playwright or Cypress, and with API testing tools.
• Understanding of API contract testing, for example Pact or OpenAPI-based validation.
• Ability to write automation in TypeScript or JavaScript.
• Experience testing authentication flows (OIDC, SAML, JWT) and complex business logic.
• Hands-on experience with AI coding and testing tools such as Claude, Cursor or GitHub Copilot, including prompt engineering.
• Practical experience bringing AI into a QA or engineering workflow, with results you can describe.
• Judgment to validate AI output: spotting hallucinated, flaky or low-value tests, and keeping sensitive data out of AI tools.
• Professional English for working with US and international colleagues.

Nice to have
• Experience testing billing, pricing or financial systems.
• Test data management across integrated systems such as Salesforce and NetSuite.
• Performance or security testing.
• Accessibility testing.
• Experience with LLM APIs, agentic or MCP-based test workflows, or testing AI-enabled features.

Benefits
• Permanent contract (contrato a término indefinido) with all legal benefits
• Competitive salary
• Private health insurance (medicina prepagada)
• Build a quality practice from scratch in a new engineering team in Medellín
• On-site role in Medellín with parking

Skills Required

  • Professional experience in test automation for web applications and APIs
  • Hands-on experience with Playwright or Cypress and API testing tools
  • Understanding of API contract testing, such as Pact or OpenAPI validation
  • Ability to write automation in TypeScript or JavaScript
  • Experience testing OIDC, SAML, JWT authentication flows and complex business logic
  • Hands-on experience with AI coding and testing tools such as Claude, Cursor, or GitHub Copilot, including prompt engineering
  • Practical experience bringing AI into a QA or engineering workflow with measurable results
  • Ability to validate AI output, identify hallucinated or flaky tests, and protect sensitive data
  • Professional English for collaboration with US and international colleagues
  • Experience testing billing, pricing, or financial systems
  • Test data management across integrated systems such as Salesforce and NetSuite
  • Performance or security testing experience
  • Accessibility testing experience
  • Experience with LLM APIs, agentic or MCP-based test workflows, or testing AI-enabled features
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Miami, FL
62 Employees
Year Founded: 2011

What We Do

Roca Alliances is a consulting agency dedicated to helping global companies build geographically diverse teams and scale their operations by outsourcing or nearshoring to Latin America. With over 15 years of expertise, the company utilizes a proprietary approach to analyze, assess, and identify ideal locations across the Americas, fostering growth and scalability for clients in various industries including technology, media, and marketing.

Similar Jobs

Remote or Hybrid
3 Locations
343 Employees
Remote or Hybrid
3 Locations
343 Employees
Remote or Hybrid
3 Locations
343 Employees

Atlassian Logo Atlassian

Head Of Product

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
19 Locations
11000 Employees

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
VCA Animal Hospitals Thumbnail
Pet • Professional Services
Los Angeles, CA
35000 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account