Software QA Engineer III

We are seeking an experienced Senior QA Automation Engineer to design, develop, and maintain comprehensive automated testing solutions at Astreya. The ideal candidate will bring deep expertise in test automation frameworks and quality engineering practices, along with a strategic mindset to shape our overall testing architecture. This role requires someone who can build robust, scalable test infrastructure collaborating across departments to ensure the highest quality standards for our products.

• Architect and implement scalable test automation frameworks across web, API, and mobile platforms

• Establish and enforce testing standards, best practices, and quality metrics

• Make critical decisions on testing tools, technologies, and methodologies

• Lead the evaluation and adoption of new testing frameworks and approaches as appropriate

• Design and implement reusable testing libraries and utilities

• Build and maintain sophisticated automated test suites using modern testing frameworks

• Create elegant solutions for complex testing scenarios including end-to-end, integration, and performance testing

• Implement advanced test data management and environment configuration strategies

• Optimize test execution for maximum coverage and efficiency

• Provide quality engineering expertise in product strategy discussions

• Identify and address testing challenges proactively

• Research and recommend innovative approaches to improve testing efficiency

• Participate in technical decision-making at the organizational level

• Contribute to long-term quality and testing roadmaps

• 4-6 years of professional experience in QA automation and quality engineering

• Proven experience building and maintaining test automation frameworks in production environments

• Bachelor's degree in Computer Science, related field, or equivalent advanced practical experience

• Track record of successfully implementing automated testing solutions at scale

• Expert-level proficiency in at least one programming language (Python, Java, JavaScript, or TypeScript)

• Advanced knowledge of test automation frameworks (Selenium, Playwright, Cypress, or WebdriverIO)

• Strong experience with API testing tools and frameworks (Postman, REST Assured, or similar)

• Experience with version control systems (Git) and branching strategies

• Advanced knowledge of test management and defect tracking tools

• Experience with mobile test automation (Appium, Detox, or XCUITest/Espresso)

• Knowledge of cloud testing platforms (BrowserStack, Sauce Labs, or LambdaTest)

• Experience with database testing and SQL

• Understanding of accessibility testing tools and compliance (WCAG, Section 508)

• Experience with contract testing (Pact) and service virtualization

• Familiarity with AI/ML-assisted testing tools

• ISTQB certification or equivalent

• Open-source contributions or personal projects demonstrating testing expertise

Primary Focus – Agentic & LLM Testing

• Validate LLM-driven agents as deterministic execution engines, not conversational systems.

• Ensure agents strictly follow system instructions, execution plans, and guardrails.

• Test decision consistency and repeatability across identical inputs and executions.

• Verify correctness of branching logic, tool invocation, retries, and fallback behavior.

• Detect and prevent hallucinated actions, unauthorized tool usage, and state inconsistencies.

• Validate agent memory and session state across long-running and concurrent executions.

Explicit Positioning (Optional but Strong)
This role is automation-first. Manual testing is not part of the responsibility.

Astreya is a global IT managed services provider, delivering technology infrastructure solutions that help businesses scale, drive innovation, and streamline operations. Founded in 2001 and headquartered in San Jose, California, Astreya operates in over 35 countries and supports some of the world's most recognized companies. Astreya provides solutions across public, private, and hybrid clouds, data centers, and the modern workplace while leveraging AI automation across it all. Our mission is to empower organizations to adapt and thrive in an ever-evolving digital landscape by transforming the way they leverage technology to support their customers, empower their employees, and grow their businesses. Learn more at www.astreya.com and follow us on LinkedIn.