Principal Backend QA Engineer (AI)

Posted 21 Days Ago
Hiring Remotely in United States
Remote
Expert/Leader
Artificial Intelligence • Cloud • Information Technology • Machine Learning • Natural Language Processing • Consulting
Cutting-edge AI, Machine Learning and Cloud Transformation company at the forefront of technological innovation
The Role
Leads enterprise quality engineering and test automation strategy across UI, API, integration, performance, and data layers. Architects Java-based automation frameworks, integrates quality gates into CI/CD pipelines, and drives AI/LLM adoption for test generation, debugging, self-healing, test data creation, and defect analysis. Establishes ETL and data validation practices, governs DevOps quality standards, mentors QA teams, and collaborates with Engineering, DevOps, Data Engineering, and Product stakeholders to improve quality maturity and delivery predictability.
Summary Generated by Built In

Unlock Your Future with Nexaminds!

At Nexaminds, we're on a mission to redefine industries with AI. We're passionate about the limitless potential of artificial intelligence to transform businesses, streamline processes, and drive growth.

Join us on our visionary journey. We're leading the way in AI solutions, and we're committed to innovation, collaboration, and ethical practices. Become a part of our team and shape the future powered by intelligent machines. If you're driven by ambition, success, fun, and learning, Nexaminds is where you belong.

Nexaminds is looking for a Senior Backend QA Engineer with strong API automation expertise and a focus on AI System Validation. In this role, you will be responsible for designing automated test frameworks, analyzing upstream service architectures, and validating non-deterministic systems (such as AI agents and chatbots). The ideal candidate excels at structuring high-quality test plans from complex requirements, utilizing modern automation frameworks, and leveraging AI techniques (like LLM as a Judge and scoring evaluations) to test applications beyond traditional deterministic methods.

Location: United States

Qualifications we are looking for:

  • API & Backend Automation: Strong hands-on experience in API test automation using Karate Framework and manual API testing with Postman.
  • AI & Non-Deterministic Testing: Understanding of testing non-deterministic systems, including response scoring techniques, AI agent/chatbot validation, or evaluation concepts like LLM as a Judge.
  • Technical Code Analysis: Ability to read and analyze source code to understand backend architectures, microservices, service dependencies, and upstream impacts.
  • Structured Test Planning: Proven skill in reviewing requirement documents to create concise, precise test plans and automation frameworks without relying on rigid language-specific constraints.
  • Local Environment Setup: Hands-on experience configuring local dev environments for early-stage (shift-left) test execution. 
  • A proactive approach to learning emerging AI technologies and building dynamic testing solutions where standard deterministic QA falls short.
  • Clear, structured, and direct technical communication.

Nice to have:

  • Hands-on experience with the Agent Development Kit (ADK) or MCP applications.
  • Background in contract testing or microservices architecture validation.
  • Prior experience working in complex enterprise environments (e.g., retail or large-scale backend systems).

Job duties:

  • API Testing & Automation: Analyze OpenAPI/Swagger specs to design comprehensive test plans, execute manual testing via Postman, and build robust automated test suites using the Karate Framework.
  • AI System & Agent Validation: Test and evaluate non-deterministic AI outputs, internal AI agents (built with ADK), and MCP applications using evaluation metrics and scoring techniques.
  • Architecture & Upstream Analysis: Inspect source code and upstream services to identify critical dependencies, evaluate technical system impacts, and manage test data across pre-production and production environments.
  • Shift-Left & Local Testing: Configure and launch local development environments to conduct early-stage testing on backend APIs and microservices before deployment.
  • AI-Integrated Test Frameworks: Design scalable test automation strategies that dynamically integrate AI capabilities to validate scenarios standard testing tools cannot handle.

What you can expect from us

Here at Nexaminds, we're not your typical workplace. We're all about creating a friendly and trusting environment where you can thrive. Why does this matter? Well, trust and openness lead to better quality, innovation, commitment to getting the job done, efficiency, and cost-effectiveness.

  • Stock options 📈
  • Remote work options 🏠
  • Flexible working hours 🕜
  • Benefits above the law
  • But it's not just about the work; it's about the people too. You'll be collaborating with some seriously awesome IT pros.
  • You'll have access to mentorship and tons of opportunities to learn and level up.

Ready to embark on this journey with us? 🚀🎉 If you're feeling the excitement, go ahead and apply!

Skills Required

  • 10+ years of experience in test automation and quality engineering
  • Architect or Principal-level experience
  • Hands-on experience applying AI in quality assurance
  • Experience with Playwright or Selenium and AI-assisted tools such as Copilot or LLMs
  • Strong hands-on programming expertise, preferably in the Java ecosystem
  • Experience building UI automation frameworks with Selenium or Playwright
  • Experience building API automation frameworks with Postman, RestAssured, or Swagger/OpenAPI
  • Experience with integration testing
  • Experience with data validation and ETL testing
  • Experience integrating automated testing into CI/CD pipelines using Jenkins, GitLab CI, Docker, or Kubernetes
  • Deep understanding of DevOps practices and release governance
  • Experience leading QA strategy for enterprise-scale platforms
  • Strong communication and stakeholder management skills
  • Advanced English proficiency, written and verbal
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Washington, DC
80 Employees
Year Founded: 2023

What We Do

Nexaminds is a cutting-edge AI and Cloud Transformation company at the forefront of technological innovation. We specialize in developing advanced artificial intelligence solutions that empower businesses to unlock their full potential. With a team of skilled AI and Cloud experts and a passion for revolutionizing industries, we are dedicated to delivering intelligent, scalable, and customized solutions tailored to meet our clients' specific needs. We strive to create innovative AI-driven solutions that enhance efficiency, productivity, and decision-making processes across industries. By leveraging state-of-the-art technology and fostering a culture of creativity, we aim to be the trusted partner that enables organizations to embrace the future with confidence.

Similar Jobs

Globe Life Logo Globe Life

Internal Sales Support (Remote)

Insurance • Financial Services
Remote
USA
3000 Employees

DraftKings Logo DraftKings

Operations Specialist

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Remote or Hybrid
United States
6400 Employees
88K-110K Annually

DraftKings Logo DraftKings

Software Engineer

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Remote or Hybrid
United States
6400 Employees
104K-130K Annually
Remote or Hybrid
2 Locations
289097 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account