Automation Test Engineer

Posted An Hour Ago
Be an Early Applicant
6 Locations
Remote
Senior level
Information Technology • Mobile • Software
The Role
Design and maintain scalable automated testing frameworks for web applications, REST APIs, and AI-powered solutions. Develop regression, BDD, performance, and API tests using tools such as Playwright, Selenium, Karate, or Gatling. Integrate quality automation into Azure DevOps CI/CD pipelines, collaborate with engineering teams, and improve software quality practices. Evaluate AI-generated outputs and apply testing approaches to LLMs, AI agents, and agentic workflows.
Summary Generated by Built In

Senior Automation Test Engineer

We are looking for a Senior Automation Test Engineer with strong experience in test automation, API and web testing, and modern quality engineering practices. This role will be responsible for designing and implementing robust automated testing strategies across web applications, APIs, and AI-powered solutions.

The ideal candidate combines a strong foundation in QA Automation and Software Engineering with practical knowledge of Large Language Models (LLMs), AI Agents, and AI-assisted development workflows.

Key Responsibilities

  • Design, develop, and maintain scalable test automation architectures and frameworks.
  • Define and execute automated testing strategies for web applications and REST APIs.
  • Develop and maintain effective automated regression testing strategies.
  • Implement BDD (Behavior-Driven Development) practices.
  • Design and execute performance testing.
  • Integrate automated testing into CI/CD pipelines, particularly within Azure DevOps environments.
  • Develop automated tests using Playwright, Selenium, Karate, Gatling, or similar technologies.
  • Collaborate with development and engineering teams to establish quality standards throughout the software development lifecycle.
  • Apply quality engineering practices to solutions incorporating Large Language Models, AI Agents, and Agentic Workflows.
  • Contribute to the evaluation and validation of AI-generated outputs and AI-assisted development processes.
  • Continuously improve testing processes, automation coverage, and quality practices.

Required Qualifications

  • 4+ years of experience in QA Automation, Software Testing, or a similar Quality Engineering role.
  • Strong experience in test automation architecture and automation strategies.
  • Solid experience with API and Web Testing.
  • Experience with BDD and regression testing strategies.
  • Experience with Performance Testing.
  • Hands-on experience with CI/CD and Azure DevOps.
  • Solid experience with one or more automation technologies such as Playwright, Selenium, Karate, Gatling, or similar tools.
  • Programming experience with Java, JavaScript/TypeScript, Python, or similar languages.
  • Strong understanding of REST APIs.
  • Experience with Git and version-control workflows.
  • English proficiency: B2 level or higher.

AI & Emerging Technology Experience

Practical experience or working knowledge in one or more of the following areas is highly valuable:

  • Large Language Models (LLMs)
  • AI Agents and Agentic Workflows
  • Prompt Engineering and Context Engineering
  • Tool Calling and AI Orchestration
  • Specification-Driven Development
  • AI-assisted code generation
  • Evaluation and validation of AI-generated outputs

Experience in these areas may come from professional environments, hands-on projects, or practical implementation within software development and QA workflows.

Skills Required

  • 4+ years of experience in QA Automation, Software Testing, or a similar Quality Engineering role
  • Experience designing test automation architectures and automation strategies
  • Experience with API and web testing
  • Experience with BDD and regression testing strategies
  • Experience with performance testing
  • Hands-on experience with CI/CD and Azure DevOps
  • Experience with Playwright, Selenium, Karate, Gatling, or similar automation technologies
  • Programming experience with Java, JavaScript, TypeScript, Python, or similar languages
  • Strong understanding of REST APIs
  • Experience with Git and version-control workflows
  • English proficiency at B2 level or higher
  • Practical experience or working knowledge of LLMs, AI agents, agentic workflows, prompt engineering, context engineering, tool calling, AI orchestration, specification-driven development, AI-assisted code generation, or evaluation of AI-generated outputs
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Franklin, TN
81 Employees
Year Founded: 2006

What We Do

Metova is a privately held leading technology company creating custom world-class mobile, web, and Internet of Things technology services for customers looking to respond to a disruption in their industry or looking to make waves as the disruptor. We build amazing things for companies that disrupt and innovate, have been building custom software solutions since 2006, and can help anyone do the same. We help companies transform their business through technology to meet the growing expectations of the customers they have and the customers they want. By helping identify their needs, we can define and build the experiences they expect, align with business goals to streamline workflows, and increase revenues while delighting customers.

Similar Jobs

Remote or Hybrid
2 Locations
289097 Employees

Engine Logo Engine

Salesforce Administrator

Consumer Web • Software • Travel
Easy Apply
Remote
10 Locations
1000 Employees

InterSystems Logo InterSystems

Administrative Assistant

Artificial Intelligence • Big Data • Healthtech • Machine Learning • Software • Database • Analytics
Easy Apply
Remote
Chile
2100 Employees

Cloudflare Logo Cloudflare

Senior Customer Engineer, LATAM - MCR (Santiago, Chile).

Cloud • Information Technology • Security • Software • Cybersecurity
Remote or Hybrid
Chile
4400 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account