The Role
Develop test strategies and cases, perform manual and automated testing, maintain web and API automation suites, investigate defects, and validate AI-enabled workflows involving LLMs, agents, RAG, tool calling, MCP, embeddings, and vector databases. Collaborate with engineering and product teams through code reviews, debugging, Agile ceremonies, and quality-risk communication.
Summary Generated by Built In
Role Overview
Coditude is looking for an AI Agentic Studio QA professional with around 4 years of experience in quality assurance
and test automation. The successful candidate will develop robust test strategies, maintain automated coverage for
web applications and APIs, and help validate AI-enabled workflows involving large language models (LLMs),
multi-agent systems, retrieval-augmented generation (RAG), tool calling, MCP, embeddings, and vector databases.
Key Responsibilities
● Design test strategies and detailed test cases for complex features and workflows.
● Perform manual and automated testing to identify, document, track, and verify bugs and defects.
● Create, maintain, and improve automated test suites for functional, integration, web, and API testing.
● Participate in code reviews and provide constructive feedback on test automation code.
● Collaborate with developers and product managers to investigate issues, debug failures, and clarify
requirements.
● Participate in Agile/Scrum ceremonies, communicate testing progress, and discuss defects, risks, and open
issues.
● Validate AI-driven functionality, including prompt behavior, agent workflows, RAG, tool calling, and output quality.
Required Skills & Qualifications
● Proficiency in Java programming and Git version control.
● Hands-on experience with web test automation using Selenium WebDriver and Java.
● Experience in API testing and automation, with working knowledge of Postman and REST Assured.
● Experience with the TestNG testing framework.
● Working knowledge of Maven and IntelliJ IDEA.
● Experience with or knowledge of Jenkins and CI/CD workflows.
● Understanding of Docker and containerization concepts.
● Understanding of LLM testing concepts, including multi-agent systems, RAG, tool calling, and MCP.
● Knowledge of testing embeddings and vector databases.
● Experience with prompt engineering and prompt/output validation.
● Understanding of Agile/Scrum methodologies and familiarity with Jira and Wiki applications.
Skills Required
- Around 4 years of experience in quality assurance and test automation
- Proficiency in Java
- Experience with Git version control
- Hands-on experience with Selenium WebDriver and Java for web test automation
- Experience with API testing and automation
- Working knowledge of Postman and REST Assured
- Experience with the TestNG testing framework
- Working knowledge of Maven
- Working knowledge of IntelliJ IDEA
- Experience with or knowledge of Jenkins and CI/CD workflows
- Understanding of Docker and containerization concepts
- Understanding of LLM testing concepts, including multi-agent systems, RAG, tool calling, and MCP
- Knowledge of testing embeddings and vector databases
- Experience with prompt engineering and prompt/output validation
- Understanding of Agile/Scrum methodologies
- Familiarity with Jira and Wiki applications
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Coditude stands out as a rapidly growing force in the digital realm, offering straightforward, impactful tech capabilities. Our team, both seasoned and savvy, is the perfect ally to thrive in the digital age. We excel in Product Development, SaaS Solutions, Enterprise Mobile Applications, AI, Cloud Solutions, Browser Extension Development, and Digital Commerce Solutions, not to mention our prowess in Infrastructure Modernization and Management
