The Role
Serve as technical owner of product quality for AI, automation, and software solutions. Build QMS, design and automate test plans across front-end, backend, AI agents, integrations, and data pipelines. Implement automated test suites, monitoring, drift detection, and intelligent alerts. Validate agent behavior, prompt quality, and large-scale workflow reliability. Partner with engineering and engagement teams to define acceptance criteria, communicate findings, and act as final technical quality gate for client deliverables.
Summary Generated by Built In
Position Overview
Dry Ground AI is seeking a Quality Engineer – AI, Software, & Automation Solutions to serve as the technical owner of product quality across all AI, automation, and software solutions delivered to clients. This role requires a deeply technical professional who can understand, test, and validate every component of our architecture. This includes front-end applications, agentic AI systems, workflow automations, backend services, integrations, voice interfaces, and data pipelines.
This is not a traditional QA position. The expectation is that this person will build, improve, and automate the entire quality function. They will use AI-enhanced development tools, create automated test harnesses, design diagnostic utilities, and implement intelligent systems that help Dry Ground AI scale internally using the same technologies we deploy for clients.
The ideal candidate is a builder with strong engineering instincts, a systems thinker who can test complex multi-layer AI behavior, and a professional who can collaborate across engineering and engagement teams to ensure that deliverables meet the highest standard before being presented to clients.
Key Responsibilities
Full Stack Quality Engineering
- Develop QMS (Quality Management Systems) framework for internal and external solutions.
- Develop comprehensive test plans across front-end, backend, automation, and AI layers.
- Validate application logic, agent workflows, API integrations, prompt quality, and error handling.
- Test AI agent behavior for reliability, consistency, safety guardrails, and edge case scenarios.
- Build automated test suites where appropriate using modern frameworks and AI tools.
- Evaluate human-in-the-loop workflows, reasoning path visibility, and agent state transitions.
Technical Ownership of QA Systems
- Create internal automation tools that support quality checks, regression testing, and consistency validation.
- Build utilities that monitor AI output correctness and detect drift or prompt failure patterns.
- Implement automated validation for large-scale workflows such as n8n, custom automations, and model-driven tasks.
- Design intelligent alerting systems that surface issues early in the development cycle.
AI and Automation Proficiency
- Use AI coding platforms to improve velocity and maintain high quality in test development.
- Build LLM-assisted testing scripts and automated evaluation harnesses for generative AI features.
- Work with engineering to integrate AI into QA processes such as automated prompt scoring and conversational flow validation.
- Contribute to the refinement of prompts, agent instructions, and reasoning frameworks from an accuracy and reliability perspective.
Cross-Functional Collaboration
- Partner with engineering to define acceptance criteria and ensure all work is testable and observable.
- Coordinate closely with the engagement manager to ensure project readiness and identify risks before client delivery.
- Communicate test findings clearly with actionable remediation guidance.
- Serve as the final technical quality gate on all deliverables.
Process Development and Continuous Improvement
- Establish Dry Ground AI’s QA standards and continuously improve them as we scale.
- Create reusable testing templates and systems for use across all client projects.
- Analyze recurring issues and lead efforts to resolve root causes.
- Drive a culture of technical excellence and reliability throughout the engineering team.
Qualifications
Required
- 5 or more years in a highly technical QA, SDET, or full-stack engineering role.
- Strong engineering fundamentals across JavaScript, TypeScript, Python, React, and API driven applications.
- Experience testing AI-enabled products, conversational interfaces, or complex automation workflows.
- Ability to build automated testing systems using tools such as Playwright, Cypress, or custom frameworks.
- Experience with AI-enhanced development tools such as Claude Code & Github.
- Strong understanding of prompt behavior, LLM variability, and common failure patterns.
- Comfort working across the entire stack, including cloud services, APIs, vector databases, and real-time systems.
- Excellent communication skills for coordinating across engineering and client-facing teams.
Preferred
- Experience with agentic AI frameworks, voice AI systems, or workflow automation tools such as n8n.
- Experience implementing testing strategies for RAG systems, embedding workflows, and vector search pipelines.
- Familiarity with CI pipelines that run automated quality checks and AI-based evaluation tests.
- Experience in consulting environments with direct ownership of client-facing deliverables.
Work Environment and Benefits
- Competitive compensation and performance incentives.
- Remote-first work environment.
- Opportunity to influence the architecture, reliability, and technical quality of AI systems across multiple industries.
- A culture that prioritizes innovation, high standards, and the use of AI to scale operations.
Skills Required
- 5 or more years in a highly technical QA, SDET, or full-stack engineering role.
- Strong engineering fundamentals across JavaScript, TypeScript, Python, React, and API driven applications.
- Experience testing AI-enabled products, conversational interfaces, or complex automation workflows.
- Ability to build automated testing systems using tools such as Playwright, Cypress, or custom frameworks.
- Experience with AI-enhanced development tools such as Claude Code & GitHub.
- Strong understanding of prompt behavior, LLM variability, and common failure patterns.
- Comfort working across the entire stack, including cloud services, APIs, vector databases, and real-time systems.
- Excellent communication skills for coordinating across engineering and client-facing teams.
- Experience with agentic AI frameworks, voice AI systems, or workflow automation tools such as n8n.
- Experience implementing testing strategies for RAG systems, embedding workflows, and vector search pipelines.
- Familiarity with CI pipelines that run automated quality checks and AI-based evaluation tests.
- Experience in consulting environments with direct ownership of client-facing deliverables.
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Dry Ground AI is an AI-native firm that helps businesses transform by building scalable, optimized business systems powered by advanced automation and machine learning. They design and deploy practical AI solutions, including custom software applications, AI agents, and automation workflows, to replace operational complexity with clarity. Their mission is to help clients dominate their industries by multiplying human potential through the strategic application of AI.
