Senior Test Automation Engineer (AI Systems)

Posted 4 Days Ago
Be an Early Applicant
7 Locations
In-Office or Remote
Senior level
Artificial Intelligence • Information Technology • Professional Services • Consulting
The Role
Design and maintain automated testing strategies for AI-enabled applications across frontend, backend, APIs, data flows, and integrations. Build automation suites, validate LLM prompts and outputs, perform integration, regression, end-to-end, performance, and load testing, investigate defects, support root-cause analysis, and integrate quality standards and release gates with development and platform teams.
Summary Generated by Built In
About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

Our client is a Big4 Consultancy group that works with leading financial institutions on AI-driven transformation, automation, advanced analytics, and financial crime prevention. Their work spans intelligent fraud detection, AML/KYC modernization, autonomous workflows, enterprise AI platforms, and the secure industrialization of AI in highly regulated environments.

We are looking for a Senior Test Automation Engineer to design and execute automated testing strategies for complex AI-enabled applications. The role spans API testing, frontend automation, backend data flows, system integration, performance testing, and validation of LLM outputs and prompt behavior.

CONTRACT: Contractor assignment, expected October 2026 – July 2027, with potential extension

COMMITMENT: Full-time

LOCATIONS: Europe-based, preferably CEE; remote, with potential future hybrid work in Prague

PROCESS: Initial qualification followed by technical and client interviews

NOTES: Fluent English is required.

Responsibilities
  • Design and maintain comprehensive automated testing strategies across frontend, backend, APIs, and data flows.
  • Build and maintain automated test suites using Selenium, Playwright, Cypress, or comparable frameworks.
  • Develop test approaches for validating LLM prompts, model outputs, consistency, and hallucination behavior.
  • Execute system integration, regression, and end-to-end testing.
  • Perform performance and load testing before production releases.
  • Validate that automated workflows meet defined business rules and performance SLAs.
  • Investigate defects, document reproducible bug reports, and support root-cause analysis.
  • Collaborate closely with developers and platform teams on issue resolution.
  • Maintain reliable regression coverage across evolving application releases.
  • Contribute to test standards, quality gates, and release-readiness criteria.

Requirements
  • 5–10 years of professional QA, test automation, or software testing experience.
  • Strong hands-on experience with Selenium, Playwright, Cypress, or similar automation frameworks.
  • Proven experience testing complex web applications, APIs, and backend integrations.
  • Experience designing and executing end-to-end, regression, and system integration tests.
  • Hands-on experience with performance or load testing.
  • Strong ability to investigate failures, identify root causes, and document defects clearly.
  • Experience integrating automated testing into CI/CD pipelines.
  • Fluent professional English.

Skills Required

  • 5–10 years of professional QA, test automation, or software testing experience
  • Hands-on experience with Selenium, Playwright, Cypress, or similar automation frameworks
  • Experience testing complex web applications, APIs, and backend integrations
  • Experience designing and executing end-to-end, regression, and system integration tests
  • Hands-on experience with performance or load testing
  • Ability to investigate failures, identify root causes, and document defects clearly
  • Experience integrating automated testing into CI/CD pipelines
  • Fluent professional English
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
6 Employees

What We Do

Gramian Consulting Group is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong foundation in software engineering and leadership, the firm helps organizations build high-performing teams by matching them with qualified professionals. They specialize in talent augmentation and recruiting, specifically focusing on connecting engineering and data/AI talent with organizations to unlock real business value.

Similar Jobs

Samsara Logo Samsara

Mid-market Account Executive

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
France
4000 Employees
20K-150K Annually

Mirakl Logo Mirakl

Business Development Representative

eCommerce • Information Technology • Retail • Software
Remote or Hybrid
7 Locations
750 Employees

Pfizer Logo Pfizer

Quality Assurance Manager

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Pfizer Logo Pfizer

Audit Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote
29 Locations
121990 Employees
163K-272K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account