Core Ownership Areas
Develop reusable agent-based workflows to accelerate delivery across multiple projects.
Define and maintain evaluation standards to ensure consistent model performance over time.
Improve system reliability across key dimensions such as accuracy, latency, and robustness.
Build shared APIs and platform components used broadly across engineering teams.
Key Responsibilities
Design and implement orchestration patterns for LLM-powered agents.
Evaluate and select models, tools, and providers based on performance, cost, and reliability.
Build testing frameworks, evaluation pipelines, and monitoring systems for AI outputs.
Implement safeguards, fallback mechanisms, and cost optimization strategies.
Collaborate with platform and backend engineers to integrate AI capabilities into scalable services.
Identify repeatable patterns across projects and convert them into reusable platform features.
Requirements
Required Experience
Strong background in building production-grade distributed systems or platform infrastructure.
Practical experience developing and deploying LLM-based or agent-driven systems.
Demonstrated ability to design for reliability, observability, and cost efficiency.
High standards for code quality and system design.
Nice-to-Have Experience
Familiarity with retrieval systems, embeddings, or context management pipelines.
Experience working within regulated or security-conscious environments.
Approach to Work
Prioritizes measurable quality through structured evaluation and testing.
Designs systems for reuse, scalability, and clean abstraction layers.
Focuses on building solutions that generalize beyond a single use case or team.
Benefits
Skills Required
- Strong background building production-grade distributed systems or platform infrastructure
- Practical experience developing and deploying LLM-based or agent-driven systems
- Experience designing for reliability, observability, and cost efficiency
- High standards for code quality and system design
- Familiarity with retrieval systems, embeddings, or context management pipelines
- Experience working within regulated or security-conscious environments
What We Do
Calliere is a boutique professional and executive recruitment and advisory firm that helps organizations build high-performance teams. It specializes in sourcing leadership, engineering, data science and AI, healthcare technology, infrastructure, telecom, sales, and business-development talent. The firm serves clients across technology, fintech, healthcare, life sciences, infrastructure, and other sectors through a personalized, thorough, results-driven approach tailored to each client's specific hiring and organizational needs.








