AI QA Engineer (m/f/d)

Posted Yesterday
Be an Early Applicant
Lisbon, PRT
Hybrid
Mid level
Automotive • Sharing Economy • Transportation • Travel
The Role
As an AI QA Engineer, you'll design and execute test plans for virtual agents and LLM systems, ensuring quality and reliability in customer support. You'll implement testing frameworks and monitor AI metrics while collaborating with teams to enhance functionality and compliance.
Summary Generated by Built In
Company Description

 

    Job Description

    As a AI QA Engineer (m/f/d), you ensure that SIXT’s virtual agents and Generative-AI–powered workflows deliver reliable, safe, and delightful support across all customer service channels. You design and run intelligent test strategies for LLM- and agent-based systems, combining classic QA skills with a deep understanding of agentic automation, conversational AI, and customer service KPIs.

    YOUR ROLE AT SIXT

    • Design and execute end-to-end test plans for customer service virtual agents (voice, chat, email). Build and maintain agentic AI test suites validating autonomous workflows (e.g., booking changes, billing, damages).
    • Define and monitor AI quality metrics such as resolution rate, deflection, CSAT, and safety violations. Develop test data and synthetic scenarios for edge cases, ambiguous queries, and multilingual requests.
    • Evaluate agent behavior through reasoning traces, tool-use decisions, and memory usage.
    • Implement and improve automated testing frameworks for conversational flows, APIs, and integrations. Contribute to LLMOps / CI/CD pipelines to automatically detect regressions.
    • Perform bias, fairness, and safety testing in line with SIXT policies and regulatory expectations. Collaborate with cross-functional teams to refine requirements and acceptance criteria.
    • Document defects, test results, and insights clearly for stakeholders.

    YOUR SKILLS MATTER

    • Foundations 2/ 3 years of experience in software QA / test engineering. Strong understanding of testing principles: functional, regression, integration, performance.
    • AI Testing Hands-on experience testing AI or ML systems such as LLM chatbots or recommendation engines. Familiarity with key concepts of multi-agentic systems, agentic frameworks (e.g., LangChain), AWS AgentCore.
    • Automation Scripting skills in Python and experience with REST API testing.
    • LLMOps: Understanding of LLMOps / MLOps: versioning, monitoring, rollback strategies.
    • Customer Focus Experience or interest in customer service processes and KPIs.
    • Communication Excellent analytical, documentation, and communication skills. Fluency in English; German or additional languages a plus.

    WHAT WE OFFER

    • A Global Tech Hub in Lisbon Join a thriving international tech community and work alongside engineers, product experts, and business teams who turn ideas into real impact. Our hubs at Factory Lisboa in Beato and ARTs Lisboa in Parque das Nações are where great tech gets built

    • Learning & Knowledge Exchange Level up through regular events with internal and external speakers. We value curiosity, continuous learning, and open exchange – across teams, disciplines, and borders

    • Flexible Work Setup Two office days a week, flexible hours, and modern spaces built for both deep focus and team collaboration – work the way that brings out your best

    • Time Off & Wellbeing Enjoy 28 vacation days per year, an additional day off on your birthday, one volunteer day annually, and private health insurance that also covers your spouse and children free of charge

    • Practical Everyday Benefits Get a yearly Coverflex allowance and a daily meal allowance to make everyday life a little easier

    • SIXT Perks Get exclusive rates on all SIXT services, with special discounts extended to your family and friends. Because great perks are even better when you can share them

    Additional Information

    About us:

    We are a globally leading mobility service provider with a revenue of €4.00 billion and around 9,000 employees worldwide. Our mobility platform ONE combines our products SIXT rent (car rental), SIXT share (car sharing), SIXT ride (taxi, ride, and chauffeur services), and SIXT+ (car subscription), giving our customers access to our fleet of 350,000 vehicles, the services of 4,000 cooperation partners, and around 5 million drivers worldwide. Together with our franchise partners, we are present in more than 110 countries at 2,000 rental stations. At SIXT, top-tier customer experience and outstanding customer service are our highest priorities. We believe in true entrepreneurship and long-term stability and align our corporate strategy with foresight. Get started with us and apply now!

    Skills Required

    • 2-3 years of experience in software QA/test engineering
    • Hands-on experience testing AI or ML systems
    • Scripting skills in Python
    • Experience with REST API testing
    • Understanding of LLMOps/MLOps
    Am I A Good Fit?
    beta
    Get Personalized Job Insights.
    Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

    The Company
    10,602 Employees
    Year Founded: 1912

    What We Do

    Sixt SE is an international provider of mobility services, offering vehicle rental, car sharing, subscriptions, and transfer services through its app and branch network.

    Similar Jobs

    Riskified Logo Riskified

    Senior Back-end Engineer

    Big Data • eCommerce • Fintech • Machine Learning • Payments • Software
    Hybrid
    Lisbon, PRT
    680 Employees

    Mastercard Logo Mastercard

    Senior Data Analyst

    Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
    Hybrid
    Lisbon, PRT
    38800 Employees

    Mastercard Logo Mastercard

    Manager - Global Product Management

    Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
    Hybrid
    Lisbon, PRT
    38800 Employees

    Mastercard Logo Mastercard

    Marketing Manager

    Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
    Hybrid
    Lisbon, PRT
    38800 Employees

    Similar Companies Hiring

    HERE Technologies Thumbnail
    Artificial Intelligence • Automotive • Computer Vision • Information Technology • Internet of Things • Logistics • Software
    Amsterdam, NL
    6000 Employees
    Blissway Thumbnail
    Computer Vision • Fintech • Hardware • Internet of Things • Machine Learning • Software • Transportation
    Denver, CO
    24 Employees
    PRIMA Thumbnail
    Travel • Software • Marketing Tech • Hospitality • eCommerce
    US
    15 Employees

    Sign up now Access later

    Create Free Account

    Please log in or sign up to report this job.

    Create Free Account