Location: Remote | Latam
Employment Type: Full-Time
We are seeking an experienced AI Quality Engineer (SDET) to join our innovative Quality Engineering team. In this role, you will be responsible for ensuring the quality, reliability, performance, and scalability of AI-powered applications, machine learning integrations, and automation workflows. As AI becomes increasingly central to our platform, you will play a critical role in defining testing strategies, validating AI-driven features, and establishing best practices for quality assurance across emerging technologies.
The ideal candidate combines a strong software testing background with a passion for AI technologies, automation, and continuous improvement. You will work closely with Product Managers, Software Engineers, Data Scientists, and DevOps teams to deliver high-quality solutions that provide exceptional customer experiences.
Reporting directly to the Vice President of Quality, this position offers a unique opportunity to influence the future of AI quality engineering while supporting continued growth and innovation.
What You’ll DoParticipate in requirements gathering, planning, and project meetings to understand business objectives, technical requirements, and deliverables.
Analyze product requirements and user stories to identify gaps, ambiguities, and testability concerns.
Design, develop, and maintain automated test frameworks and test cases using Python or Java.
Validate AI-powered features, machine learning integrations, APIs, and automation workflows for accuracy, reliability, and performance.
Develop automated tests for RESTful APIs, marketplace integrations, and distributed system components.
Identify complex business- and marketplace-specific scenarios, perform exploratory and manual testing when appropriate, and drive automation coverage.
Create and execute automated acceptance, regression, integration, and end-to-end tests within Agile development cycles.
Collaborate closely with Product Owners, Developers, and Data teams to clarify requirements and ensure quality throughout the software development lifecycle.
Analyze test results, investigate defects, and provide actionable feedback to engineering teams.
Support production issue investigations through root cause analysis, testing, and validation efforts.
Contribute to CI/CD pipelines using Jenkins, GitHub, and related automation tools to streamline testing and deployment processes.
Develop and maintain QA documentation, including test plans, test strategies, test cases, traceability matrices, and quality metrics.
Help establish and evolve testing methodologies, tools, and best practices for AI-driven products and services.
Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related technical field preferred.
2+ years of experience in software quality assurance, test automation, or Software Development Engineer in Test (SDET) roles.
2+ years of experience working in Agile/Scrum environments.
2+ years of experience with Python preferred; experience with Java is also highly valued.
Experience testing APIs, integrations, and distributed systems.
Strong understanding of Software Development Life Cycle (SDLC), software testing methodologies, and quality engineering principles.
Experience working with AI-powered applications, machine learning systems, or intelligent automation solutions is a plus.
Proficiency working with JSON, XML, and API-based integrations.
Experience with Atlassian tools, including Jira and Confluence.
Familiarity with CI/CD practices and tools such as Jenkins, GitHub Actions, or similar platforms.
Strong SQL and relational database skills, including the ability to write and execute queries to validate application behavior and test results.
Experience using REST API testing and automation tools.
Proficiency in at least one object-oriented programming language.
Strong analytical, troubleshooting, and problem-solving skills.
Ability to work independently while collaborating effectively across cross-functional teams.
Strong organizational skills with the ability to manage multiple priorities in a fast-paced environment.
Demonstrated ownership, accountability, and commitment to delivering high-quality software solutions.
Experience testing AI/ML applications, large language model (LLM) integrations, conversational AI systems, or generative AI solutions.
Experience with test automation frameworks such as PyTest, Selenium, Playwright, Cypress, or similar tools.
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
Exposure to performance, scalability, and security testing practices.
Experience working with modern observability and monitoring tools.
Competitive Salary: Earn a USD salary that matches your skills and experience.
Paid Time Off: We value work-life balance, offering PTO so you can recharge.
Health Insurance Subsidy: Your health matters, and we help with a subsidy to cover your care.
Salary Reviews every year!
Paid Training and Certifications
Ready to put your puzzle-solving skills to the test? Join our team today!
Want to learn more about us?
LinkedIn: Puzzle
Instagram: @puzzle.tech_
Skills Required
- 2+ years of experience in software quality assurance, test automation, or SDET roles
- 2+ years experience working in Agile/Scrum environments
- Ability to design, develop, and maintain automated test frameworks using Python or Java
- Experience testing APIs, integrations, and distributed systems
- Proficiency with JSON and XML
- Strong SQL and relational database skills
- Experience with REST API testing and automation tools
- Familiarity with CI/CD practices and tools such as Jenkins or GitHub Actions
- Experience with Atlassian tools (Jira, Confluence)
- Proficiency in at least one object-oriented programming language
- Bachelor's degree in Computer Science, Software Engineering, Information Systems, or related (preferred)
- Experience with Python (2+ years preferred); experience with Java highly valued
- Experience testing AI/ML applications, LLM integrations, conversational or generative AI
- Experience with test automation frameworks such as PyTest, Selenium, Playwright, Cypress
- Familiarity with cloud platforms (AWS, Azure, Google Cloud)
- Exposure to performance, scalability, and security testing practices
- Experience with observability and monitoring tools
- Strong analytical, troubleshooting, and problem-solving skills
What We Do
Puzzle Consulting Services is a software consulting firm that helps industry-leading customers achieve supply chain and business success. The company provides professional services including the implementation of the Bright Suite of solutions for warehouse, order, sourcing, and inventory management. They serve a variety of sectors, including consumer goods, food and beverage, third-party logistics, transportation, and shipping.
.png)







