The Role
As a QA Engineer, design and execute test strategies for AI products, focusing on automation, edge case analysis, and cross-functional collaboration to ensure product reliability.
Summary Generated by Built In
About Mistral
At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.
We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work.
We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited.
Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers.
Role summary
We are seeking a skilled and proactive QA Engineer to join our team and ensure the reliability, accuracy, and robustness of our AI-powered products. In this role, you will design and execute test strategies for our applications, APIs and machine learning models. Your work will involve automated testing, edge-case analysis, and collaboration with cross-functional teams to deliver seamless, high-quality user experiences. If you thrive in a dynamic environment and are passionate about quality in AI systems, this is a perfect opportunity to make a tangible impact.
What you will do
Test Automation: Develop automated test suites to validate app features, APIs, and model integrations, ensuring end-to-end reliability and user experience.
Edge Case Analysis: Collaborate with PMs and other stakeholders to identify and rigorously test edge cases, improving the robustness of both platform features and models.
Quality Platform Development: Contribute to building tools and frameworks that enable more efficient and scalable quality testing processes across the organization.
Release Readiness Validation: Implement pre-release quality gates to validate models, APIs, and platform updates, providing a green light for production releases.
Systematic QA Campaigns: Design and lead comprehensive quality assurance campaigns, including functional, stress, and performance testing, to proactively identify potential issues.
About you
• You have proven ability to create and execute comprehensive test strategies, covering functional, regression, and exploratory testing for AI products.
• You are proficient in QA tools like Playwright, Postman, or similar platforms for API and functional testing.
• You’re skilled in identifying, documenting, and collaborating with developers to resolve issues efficiently.
• You are autonomous and a self-starter.
• You are a proactive problem-solver with a continuous improvement mindset.
• You are proficient in Python or Typescript.
Now it would be ideal if you have :
• Experience testing Machine Learning models.
• Understanding of the Machine Learning lifecycle.
• Experience in various types of testing : performance, load, accessibility or others
• Strong debugging skills.
Hiring Process
- Recruiter Screening (30min)
- Hiring Manager Interview (30min)
- Take-home + review/scripting (1 week / 60 min)
- Stakeholders interview with Engineering team lead (30 min)
- Culture-fit discussion (30min)
- Reference checks
Location & Remote
The position is based in our Paris HQ offices and we encourage going to the office as much as we can (at least 3 days per week) to create bonds and smooth communication. Our remote policy aims to provide flexibility, improve work-life balance and increase productivity. Each manager can decide the amount of days worked remotely based on autonomy and a specific context (e.g. more flexibility can occur during summer). In any case, employees are expected to maintain regular communication with their teams and be available during core working hours.
What we offer
💰 Competitive salary and equity package
🧑⚕️ Health insurance
🚴 Transportation allowance
🥎 Sport allowance
🥕 Meal vouchers
💰 Private pension plan
🍼 Generous parental leave policy
Top Skills
Playwright
Postman
Python
Typescript
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Fast, open-source and secure language models. Facilitated specialisation of models on business use-cases, leveraging private data and usage feedback.
Built from a world-class team in Europe, targeting global market. Join the team ! https://jobs.lever.co/mistral/
