Senior AI/ML Engineer - Test Automation | RAG | Self-Healing | LLM

CodeNinja is a next-generation technology consulting firm specialising in AI-powered transformation, enterprise software delivery, and Quality Engineering. Headquartered in the Gulf region and operating across the MENA, South Asia, and global markets, CodeNinja partners with Tier-1 banks, government entities, and large enterprises to design, build, and run mission-critical technology programs.

With deep expertise in QA transformation, test automation, DevOps modernisation, and AI/ML engineering, CodeNinja's teams combine global delivery standards with in-market contextual knowledge — ensuring outcomes that are compliant, scalable, and commercially aligned with client objectives.

For the Client's Test Management Enablement & Automation engagement, CodeNinja brings a dedicated 12-person specialist team spanning Test Management, Automation Engineering, AI/ML, and Performance Testing — all governed under a structured 20-week program delivery framework.

The AI/ML Engineer builds the RAG pipeline for BRD-to-test-plan generation, develops self-healing locator models, implements risk-based regression optimisation, and operates within the client's AI governance framework. This is a pioneering role at the cutting edge of intelligent test automation.

•        Design and build the Retrieval-Augmented Generation (RAG) pipeline to analyse BRD documents and generate test plans and test designs.

•        Develop self-healing element identification models for UI automation, targeting >85% recovery rate.

•        Implement risk-based regression optimisation algorithms to prioritise test execution by change impact.

•        Build defect clustering and root cause pattern recognition capabilities.

•        Ensure all AI models operate within the client's AI governance framework: PII-free training data, synthetic data only, human-in-the-loop validation.

•        Version-control all AI models with rollback capability and maintain comprehensive audit trails.

•        Produce explainable AI outputs with confidence scores and reasoning traceability.

•        Collaborate with the client's CISD and AI governance teams on model approvals and compute/GPU access.

•        6+ years of ML/AI engineering experience, with at least 2 years applying AI to software testing or QA.

•        Strong experience building RAG pipelines with LLMs (GPT-4, Claude, Llama, or equivalent).

•        Proficiency in Python, vector databases (Pinecone, Weaviate, or ChromaDB), and embedding models.

•        Experience with self-healing test automation concepts and dynamic element locators.

•        Understanding of AI governance, explainability, and bias detection in enterprise contexts.

•        Experience working within bank-hosted or air-gapped AI environments.

•        Preferred Certifications: Google Cloud ML Engineer, Azure AI Engineer Associate, AWS ML Specialty (bonus).

•        Work on high-impact, flagship banking transformation programs with a Tier-1 Saudi financial institution.

•        Be part of a team that's shaping the future of AI-enabled test automation in the MENA region.

•        Collaborate with world-class QA professionals across onsite and offsite delivery models.

•        Access to continuous upskilling — certifications, AI/ML tooling, and emerging QA methodologies.

•        Competitive compensation with performance-linked incentives and career progression pathways.

•        A culture that values technical excellence, ownership, and innovation without bureaucracy.

This job description outlines the primary responsibilities and qualifications for the role at the time of posting. It is not exhaustive and may evolve in line with business needs and project requirements. CodeNinja reserves the right to modify role scope as the engagement progresses.

All candidates will be subject to standard background verification. Onsite positions require compliance with the client's site access, security, and NDA policies. CodeNinja is an equal opportunity employer and welcomes applications from all qualified individuals regardless of background.