Ciklum is looking for a Senior Manual QA Engineer (AI / LLM & API Testing) to join our team full-time in India.
We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.
About the role:
As a Senior Manual QA Engineer (AI / LLM & API Testing), become a part of a cross-functional development team engineering experiences of tomorrow. We are seeking a Senior Manual QA Engineer (AI / LLM & API Testing) with 6+ years of experience in QA engineering. The ideal candidate will have strong expertise in API testing, test automation frameworks, and CI pipeline integration, with added exposure to RAG/LLM output evaluation and multilingual testing. This role is central to ensuring quality across the platform, defining test strategies, and validating outputs across multiple systems and languages.
Ciklum’s client project is an AI-powered platform that transforms 1.5 million annual support tickets into reusable knowledge, enabling agents to resolve issues faster and deflect tickets before they open.
Ciklum is the named platform partner responsible for building the Vector DB, RAG backbone, and Knowledge Engine on top of CGM’s existing infrastructure.The full-stack team operates on a blended onshore/offshore T&M model across Czechia, Poland, UK, and India.
Responsibilities:
- Own quality assurance across the platform, including:
- Retrieval accuracy and relevance testing
- Multilingual output validation across German, Italian, French, and Dutch
- NICE sync and writeback verification with versioning and deprecation handling
- API contract testing for the portal and Boost.ai consumers
- Regression coverage for the agent triage surface
- Define test strategy and acceptance criteria with the Business Analyst (BA) against the Phase 1 scope
- Collaborate with engineering teams to integrate QA processes into CI/CD pipelines
- Ensure consistent quality across multilingual environments and AI-driven outputs
Requirements:
- 3+ years of experience in QA engineering
- Hands-on experience with test automation frameworks (pytest or equivalent)
- Strong API testing skills using Postman or REST-based tools
- Experience with CI pipeline integration
- Exposure to RAG or LLM output evaluation is a plus
- Experience with multilingual testing (German, Italian, French, Dutch) is highly valued
- Tech stack: test automation frameworks, API testing (Postman/REST), CI integration
- Strong analytical and problem-solving skills
- Ability to define clear acceptance criteria and test strategies
- Detail-oriented with a focus on accuracy and consistency
- Collaborative mindset with the ability to work closely with BAs, developers, and leads
- Passion for ensuring high-quality user experiences across diverse environments
What’s in it for you?
- Strong community: Work alongside top professionals in a friendly, open-door environment
- Growth focus: Take on large-scale projects with a global impact and expand your expertise
- Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
- Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
- Care: We’ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations
About us:
At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.
India is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game-changing solutions and take your career to the next level.
Explore, empower, engineer with Ciklum!
Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.
#LI-RB1
Skills Required
- 6+ years of experience in QA engineering
- 3+ years of experience in QA engineering
- Hands-on experience with test automation frameworks such as pytest or equivalent
- Strong API testing skills using Postman or REST-based tools
- Experience with CI pipeline integration
- Exposure to RAG or LLM output evaluation
- Experience with multilingual testing in German, Italian, French, and Dutch
- Strong analytical and problem-solving skills
- Ability to define clear acceptance criteria and test strategies
- Detail-oriented approach focused on accuracy and consistency
- Ability to collaborate with business analysts, developers, and leads
What We Do
Ciklum is a global Digital Solutions Company for Fortune 500 and fast-growing organisations alike around the world. The company is headquartered in London and has software development centres and branch offices in the United States, Spain, Switzerland, Denmark, Israel, Poland, Ukraine, Czech Republic, Slovakia, Romania, UAE and Pakistan. Ciklum builds tailored digital solutions that leverage emerging technologies for such clients as Just Eat, Flixbus, Metro Markets, EFG International, Zurich Insurance, Lottoland and others. For more information about us visit www.ciklum.com
.jpeg)
