The Role
About Mistral
At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.
We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work.
We are a dynamic, collaborative team passionate about AI and its potential to transform society.
Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited.
Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers.
What you will do
• Model Behavior Testing: Develop and execute tests to validate the behavior of machine learning models, ensuring they produce consistent, accurate, and contextually appropriate outputs.
• API Testing Automation: Build automated testing suites to ensure APIs function correctly and integrate seamlessly with the inference stack, preventing critical errors during deployment.
• Edge Case Analysis: Collaborate with PMs and other stakeholders to identify and rigorously test edge cases, improving the robustness of both models and platform features.
• Release Readiness Validation: Implement pre-release quality gates to validate models, APIs, and platform updates, providing a green light for production releases.
• Systematic QA Campaigns: Design and lead comprehensive quality assurance campaigns, including functional, stress, and performance testing, to proactively identify potential issues.
• Quality Platform Development: Contribute to building tools and frameworks that enable more efficient and scalable quality testing processes across the organization.
About you
• You have a proven ability to create and execute comprehensive test strategies, covering functional, regression, and exploratory testing.
• You are proficient in QA tools like Postman, Selenium, or similar platforms for API and functional testing.
• You’re skilled in identifying, documenting, and collaborating with developers to resolve issues efficiently.
• You are autonomous and a self-starter.
• You are a proactive problem-solver with a continuous improvement mindset.
Now it would be ideal if you have :
• Experience testing Machine Learning models.
• Understanding of the Machine Learning lifecycle.
• Proficiency in Python or similar languages.
• Hands-on API testing experience.
• Strong debugging skills.
Hiring Process
- Recruiter Screening (45min)
- Hiring Manager Interview (30min)
- Take-home test
- Live-Coding (Scripting) (60min)
- Culture-fit discussion (30min)
Location
We do not require you to be based in a specific location as long as it is in one of the countries listed in this job posting. However, you will be expected to be available for a monthly visit to one of our offices:
• 🇫🇷 🇩🇪 🇪🇸 If based in France, Germany or Spain: we will ask you to come to our Paris office 3 days per month
• 🇬🇧 If based in the UK: we will ask you to come to our London office 3 days per month
• We will cover 100% of inter-country travelling and 50% of intra-country travelling fees
Besides, please note that we ask all new hires to come to our Paris HQ for the first month of their onboarding (accommodation and travelling covered).
What we offer
💰 Competitive cash salary and equity
🧑⚕️ Health insurance *
🚴 Transportation allowance
🥎 Sport allowance
🥕 Meal vouchers
💰 Private pension plan
🍼 Parental : Generous parental leave policy **
🌎 Visa sponsorship **
* currently not available for Germany
** available for France only
Similar Jobs
.png)
.png)
.png)
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Fast, open-source and secure language models. Facilitated specialisation of models on business use-cases, leveraging private data and usage feedback.
Built from a world-class team in Europe, targeting global market. Join the team ! https://jobs.lever.co/mistral/
