At IT Labs, we're searching for a unique kind of talent, an SDET who lives and breathes AI. Someone who understands that quality assurance in the age of intelligent systems means going beyond the surface — testing not just code, but cognition.
As an AI SDET, you’ll be instrumental in defining how we test products powered by language models and context-aware intelligence. You’ll work closely with engineers building conversational systems designed to understand business-specific language, structures, and knowledge. The role requires someone who’s not afraid to build a testing framework from the ground up, someone who can navigate APIs, performance bottlenecks, and model output evaluation with confidence.
You’ll also help establish best practices and bring structure to a space where traditional testing tools meet emerging AI behavior.
Primary Responsibilities include:
- Collaborate with AI/ML engineers in testing intelligent features that interface with enterprise data and dynamic knowledge sources.
- Build and maintain test automation frameworks that can validate outputs from models — both through APIs and interactive systems.
- Design performance, functional, and edge-case testing scenarios for complex AI-driven workflows.
- Help define the metrics and data pipelines needed to evaluate the quality and reliability of AI responses.
- Support test strategy definition for systems that continuously learn or adapt based on user interaction and internal content.
Additional Responsibilities may include:
- Integrating automation scripts into continuous integration processes using tools like Jenkins and GitHub Actions, and advocating for continuous testing practices.
- A degree in Computer Science, Mathematics, Statistics, or similar — or 5-7 years of proven hands-on experience.
- Background in testing machine learning models or AI-powered services.
- Strong experience with at least one programming language (Python, Java, R, Scala, Julia).
- Comfort creating test data and simulating interactions for AI-driven systems.
- Prior experience building out test infrastructure, not just using existing frameworks.
- Familiarity with test tools like JMeter, Rest Assured, or similar.
- Understanding of AI/ML concepts — especially NLP, LLMs, or systems that retrieve and generate contextual answers.
- Exposure to modern DevOps and deployment environments: GitHub Actions, Jenkins, Docker, Kubernetes, Helm.
You are:
- Experienced in building backend test automation scripts and frameworks and working in a continuous delivery/continuous testing environment.
- Experienced in working within an Agile/Scrum development process.
- Able to identify testing and quality challenges and create innovative solutions to solve complex problems.
- A person with strong communication skills who enjoys collaborating with co-workers.
- Able to combine automation skills with manual testing (exploratory).
- Capable of thinking independently with curiosity, criticism, and keen attention to detail.
- Well-organized and accustomed to working in an innovative environment.
- Long-term 12-month contract
- Choose your contract: Contractor or B2B,
- 10 Days PTO after 4 months of working in IT Labs,
- Referral Bonuses,
- Virtual Knowledge Sharing Sessions, Events and Team Hangouts.
Our values
We are a company that seeks the best for both our employees and clients, reaching beyond expectations in turning dreams into reality. Our way of working is rooted in our core values (Integrity, Excellence, Proactivity, Innovation, and People), with an expectation that our future colleagues will make these their second nature in their everyday work and life. We don’t ask for perfection, but we do appreciate people motivated to better themselves in every conceivable aspect.
About IT Labs
Founded in 2005, IT Labs is an international software tech company, specializing in purpose and process-driven teams for high-performance, innovation, transformation, and efficiency. Our HQ is in Palm Beach Gardens, Florida, and we have teams and offices around the world - the US, the UK, the Netherlands, Argentina, Brazil, Serbia, and North Macedonia. We are constantly growing, and we would love for you to become part of our team!
Similar Jobs
.png)
What We Do
IT Labs a global technology development company specializing in providing high-performing teams that are process driven and provide guaranteed results. Our teams are modeled in a way that perfectly matches to our clients' needs and our process is proven to deliver high-quality deliverables, on time and on the budget, every time, guaranteed.
IT Labs is proud to be a Microsoft Partner, Amazon Web Services Technology Partner, and is certified for ISO 9001, 14001, 27001, and 27000-1.
Team-As-A-Service
IT Labs has established itself as the leading provider of software development teams. Our focus on hand-picking the right talent, combining it into a team with compatible skill-sets, along with continuous talent development, has enabled us to provide our clients with prepared, process-enabled, reliable teams, ready to start on short notice.
Digital Transformation & Innovation
Utilizing our complete product development lifecycle process, we help develop innovative solutions for mature companies or startups. Aligning the revenue strategy, business model, short-term and long-term goals, we help companies establish suitable digital transformation and process-optimization.
Integrity & Loyalty
Long-term client care is the number one priority at our company. We enjoy the time that we spend on projects. We are only interested in establishing long-term business relationships with our clients/partners that involve a great deal of synergy and mutual success.
IT Labs’ Educational Lab
Sixty percent of our workforce is trained in-house. IT Labs’ Educational Lab is one of the most important parts of our intellectual power. It creates new experts with fresh and ambitious ideas. The goal of the lab is to train the company’s future talent by perfecting their skill-sets, embracing the process and enjoying the corporate culture.
