The Role
Designs, builds, deploys, and maintains production AI agent workflows and RAG pipelines. Responsibilities include prompt engineering, tool orchestration, retrieval optimization, automated validation, evaluation frameworks, feedback loops, monitoring, and scalable error handling. The role requires collaboration with Data Scientists and experience developing data pipelines for AI systems. Preferred experience includes multi-agent systems, multimodal AI, RLHF, generative AI evaluation, and LLM cost optimization.
Summary Generated by Built In
Senior AI/ML Engineer
Job requirements
- Design and build end-to-end AI agent workflows, from initial prompt design through production deployment, ensuring scalable and reliable solutions
- Develop and optimize Retrieval-Augmented Generation (RAG) pipelines by implementing chunking strategies, embedding models, retrieval ranking, and context window management for precise information retrieval
- Build and iterate on prompt engineering layers, systematically testing and refining prompts and chain-of-thought strategies to deliver consistent outputs across diverse inputs
- Implement tool orchestration within agent workflows, integrating agents with databases, rule engines, validation systems, and formatting tools for seamless operation
- Establish automated quality checks and validation layers to proactively identify and resolve issues before outputs reach human reviewers
- Collaborate with Data Scientists to instrument solutions for measurement, developing evaluation frameworks and tracking solution performance against defined targets
- Deploy, monitor, and maintain AI/ML solutions in production environments, ensuring reliability, scalability, and robust error handling
- Design and implement feedback loops to capture expert review data and translate it into measurable improvements in agent performance
- Advanced proficiency in Python
- Hands-on experience with LLM frameworks such as LangChain or LlamaIndex
- Expertise in prompt engineering for systematic testing and iteration
- Deep understanding of RAG architectures including embedding models, vector stores, retrieval strategies, and re-ranking
- Experience building multi-step agent workflows with tool use and branching logic
- Experience deploying and maintaining AI/ML solutions in production environments
- Experience with data pipeline development for feeding AI systems
- Experience with multi-agent orchestration frameworks
- Background in content generation, translation, or document processing solutions
- Familiarity with feedback loops, RLHF, or reward model training
- Knowledge of multi-modal AI systems including voice-to-text, document understanding, and image analysis
- Experience with evaluation frameworks for generative AI and automated scoring
- Experience with LLM cost optimization strategies such as model routing, caching, and prompt compression
- Bachelor's degree in Computer Science, Data Science, Information Technology, Statistics, or a closely related discipline
- Certification in Machine Learning or Artificial Intelligence (e.g., TensorFlow Developer Certificate, AWS Certified Machine Learning – Specialty)
- Certification in LLM engineering or generative AI (e.g., DeepLearning.AI Generative AI with LLMs)
Experience Range: 2 to 4 years of experience, including at least 2 years specifically focused on developing LLM-based applications, RAG systems, or AI agent workflows Key Responsibilities:
Required Skills:
Preferred Skills:
Desired Qualifications:
Skills Required
- 2 to 4 years of professional experience, including at least 2 years developing LLM-based applications, RAG systems, or AI agent workflows
- Advanced proficiency in Python
- Hands-on experience with LangChain or LlamaIndex
- Expertise in prompt engineering, systematic testing, and iteration
- Deep understanding of RAG architectures, embedding models, vector stores, retrieval strategies, and re-ranking
- Experience building multi-step agent workflows with tool use and branching logic
- Experience deploying and maintaining AI/ML solutions in production environments
- Experience developing data pipelines for AI systems
- Experience with multi-agent orchestration frameworks
- Background in content generation, translation, or document processing solutions
- Familiarity with feedback loops, RLHF, or reward model training
- Knowledge of multimodal AI systems, including voice-to-text, document understanding, and image analysis
- Experience with generative AI evaluation frameworks and automated scoring
- Experience with LLM cost optimization, including model routing, caching, and prompt compression
- Bachelor's degree in Computer Science, Data Science, Information Technology, Statistics, or a closely related discipline
- Certification in Machine Learning or Artificial Intelligence
- Certification in LLM engineering or generative AI
Brillio Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Brillio and has not been reviewed or approved by Brillio.
-
Healthcare Strength — Healthcare is considered comprehensive, including medical coverage for employees and dependents alongside life, disability, and accidental death protections. Feedback suggests these protections are a core strength of the package.
-
Leave & Time Off Breadth — Time-off options include paid leave and parental leave, with flexible or ‘flexible PTO’ approaches cited in some contexts. Feedback suggests this breadth helps support work-life balance when team norms permit usage.
-
Wellbeing & Lifestyle Benefits — Wellbeing offerings span counseling, financial-management sessions, fitness programs, and travel insurance, plus region-specific extras like discounted IT hardware and work-from-home essentials. Feedback suggests these add-ons enhance perceived value beyond core insurance.
Brillio Insights
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.
.png){kind=logo}
