Be an Early Applicant
GTM leaders trust Mindtickle’s Revenue Enablement Platform to drive behavior change across customer-facing roles.
The Role
The SDET-II will own the AI testing lifecycle, design automation frameworks, lead feature testing, ensure LLM quality, mentor others, and improve engineering practices.
Summary Generated by Built In
Who we are
Mindtickle is the market-leading revenue productivity platform that combines on-the-job learning and deal execution to get more revenue per rep. Mindtickle is recognized as a market leader by top industry analysts and is ranked by G2 as the #1 sales onboarding and training product. We’re honoured to be recognized as a Leader in the first-ever Forrester Wave™: Revenue Enablement Platforms, Q3 2024!
What’s in it for you?
- Own the end-to-end qualification lifecycle for AI/LLM systems from ideation and implementation to CI/CD integration.
- Design and implement scalable automated test suites across unit, integration, regression, and system levels.
- Build and enhance frameworks to test, evaluate, and continuously improve complex AI and LLM workflows.
- Lead the design and automation of LLM-powered features, including prompt pipelines, RAG workflows, and AI-assisted developer tools.
- Develop evaluation pipelines to measure factual accuracy, hallucination rates, bias, robustness, and overall model reliability.
- Define and enforce metrics-driven quality gates and experiment tracking workflows to ensure consistent, data-informed releases.
- Collaborate with agile engineering teams, participating in design discussions, code reviews, and architecture decisions to drive testability and prevent defects early (“shift left”).
- Develop monitoring and alerting systems to track LLM production quality, safety, and performance in real time.
- Conduct robustness, safety, and adversarial testing to validate AI behavior under edge cases and stress scenarios.
- Continuously improve frameworks, tools, and processes for LLM reliability, safety, and reproducibility.
- Mentor junior engineers in AI testing, automation, and quality best practices.
- Measure and improve Developer Experience (DevEx) through tools, feedback loops, and automation.
- Champion quality engineering practices across the organization, ensuring delivery meets business goals, user experience, cost of operations etc.
We’d love to hear from you, if you:
- LLM testing & evaluation tools: MaximAI, OpenAI Evals, TruLens, Promptfoo, LangSmith
- Building LLM-powered apps: prompt pipelines, embeddings, RAG, AI workflows
- CI/CD design for application + LLM testing
- API, performance, and system testing
- Git, Docker, and cloud platforms (AWS / GCP / Azure)
- Bias, fairness, hallucination detection & AI safety testing
- Mentorship and cross-functional leadership
Preferred Qualifications
- Bachelor’s or Master’s in Computer Science, Engineering, or equivalent.
- 4+ years in software development, SDET, or QA automation.
- Proficiency in GoLang, Java, or Python.
- Proven experience building test automation frameworks.
- Proven ability to design CI/CD pipelines with automated regression and evaluation testing.
- Hands-on exposure to LLMs, GenAI applications.
- 2+ years of hands-on experience with LLM APIs and frameworks (OpenAI, Anthropic, Hugging Face).
- Proficient in prompt engineering, embeddings, RAG, and LLM evaluation metrics.
- Strong analytical, leadership, and teamwork skills.
- Excellent communication and collaboration across teams.
Our culture & accolades
As an organization, it’s our priority to create a highly engaging and rewarding workplace. We offer tons of awesome perks and many opportunities for growth.
Our culture reflects our employee's globally diverse backgrounds along with our commitment to our customers, and each other, and a passion for excellence. We live up to our values, DAB, Delight your customers, Act as a Founder, and Better Together.
Mindtickle is proud to be an Equal Opportunity Employer.
All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, national origin, disability, protected veteran status, or any other characteristic protected by law.
Your Right to Work - In compliance with applicable laws, all persons hired will be required to verify identity and eligibility to work in the respective work locations and to complete the required employment eligibility verification document form upon hire.
Top Skills
AWS
Azure
Docker
GCP
Git
Go
Java
Python
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Mindtickle provides a comprehensive, data-driven solution for sales readiness and enablement that fuels revenue growth and brand affinity. Its purpose-built applications, proven methodologies, and best practices are designed to drive effective sales onboarding and ongoing readiness.
With Mindtickle, revenue and sales leaders can continually assess, diagnose and develop the knowledge, skills, and behaviors required to effectively engage buyers and drive growth. Companies across a wide range of industries use Mindtickle's innovative capabilities for onboarding, training, bite-sized mobile updates, gamification-based learning, call recording, coaching and role-play to ensure world-class sales performance.
