AI Quality Engineer

About us:  

Populix is a consumer insights platform that helps businesses connect with its database of respondents and provides them with insights to better understand the preferences of Indonesian consumers. Populix has a pool of over 1,000,000 diverse, readily accessible, and highly qualified respondents across Indonesia. Its products range from intensive research studies to simple surveys and can be arranged on a project or subscription basis. Focusing on Indonesian consumers being super sticky to their phones, Populix facilitates a diverse range of data collection methods via its mobile app.
 

We are seeking an AI Quality Engineer with a unique focus: not only ensuring functional software quality but also pushing the boundaries of AI-driven applications. This role goes beyond traditional QA by requiring creativity, curiosity, and the ability to role-play as diverse users to uncover hidden risks, biases, or unexpected behaviors in AI systems.

As part of our cross-functional team, you will collaborate closely with Product Managers, Data Scientists, and Engineers to ensure our AI-powered products are robust, accurate, and deliver exceptional user experiences.

• Design, develop, and execute manual and automated test plans for web, mobile, and AI-driven applications.
• Explore AI product use cases by simulating real-world scenarios and role-playing different types of users to identify limitations, edge cases, biases, and inaccuracies.
• Perform functional, regression, integration, and non-functional testing (e.g., performance, usability, security).
• Collaborate with Product Managers, Data Scientists, and Engineers to define quality standards and validate AI model outputs for accuracy, fairness, and reliability.
• Assess product quality from multiple angles, including end-to-end integration, interpretability of results, and UI/UX experience.
• Build and maintain test automation frameworks (e.g., Cypress, Selenium, Playwright, JUnit) to increase test efficiency and coverage.
• Support CI/CD pipelines with integrated automated testing for smooth, reliable releases.
• Clearly document test results, bugs, and edge-case analyses, providing actionable feedback.
• Champion a culture of quality throughout the product lifecycle, from requirements to release and beyond.
• Stay current with AI testing methodologies and propose innovative approaches to validate model performance and safety.

• 3+ years of QA experience (manual and automated testing).
• Strong ability to design test strategies, test cases, and automation frameworks.
• Hands-on experience with automation tools such as Cypress, Selenium, Playwright, JUnit, or similar.
• Familiarity with CI/CD pipelines and test integration within development workflows.
• Experience testing complex systems with multiple integration points (APIs, data pipelines, front-end, back-end).
• Excellent analytical and problem-solving skills, with a strong “think like a user” mindset.
• Effective communication skills to clearly report bugs, risks, and test results to both technical and non-technical stakeholders.
• 1+ year of experience testing AI/ML-based products, with knowledge of bias, model drift, fairness, and interpretability.
• Knowledge of Python and TypeScript, data pipelines, or AI testing frameworks to better collaborate with data scientists.