We’ve partnered with a YC-backed AI startup to find a Forward Deployment Engineer who will work directly with their customers to set up robust evaluation processes using internal tooling. You’ll play a key role in designing and deploying AI evaluation infrastructure, helping customers integrate evaluation pipelines into their workflows, and making sure their systems produce measurable, reliable outcomes.
What You'll DoWork hands-on with customers to establish end-to-end evaluation pipelines
Help with data curation, define annotation schemes, and set up LLM-based judges
Set up and run initial evaluation experiments, producing actionable results
Integrate the evaluation tooling with customers' existing infrastructure
Translate technical systems into practical, usable workflows for end users
Enjoy working at the intersection of engineering, product, and customer needs.
Have prior experience working with RAG, LLM pipelines, and agents
Can navigate ambiguous setups and build structure in complex AI workflows
Lexoga One helps early-stage and high-growth startups find exceptional engineering and AI talent. We work with some of the most ambitious teams in tech to help them scale by finding the right people, fast. Each role on Lexoga One is curated with deep insight into the team, tech, and impact.
Note: We're hiring on behalf of a YC-backed AI startup. Selected candidates will receive company details in the next step.
Salary Range$60k - $180k USD
Skills Required
- Prior experience working with RAG, LLM pipelines, and agents
- Experience designing and deploying AI evaluation infrastructure and evaluation pipelines
- Experience with data curation and defining annotation schemes
- Experience setting up LLM-based judges and running evaluation experiments
- Experience integrating tooling with customers' existing infrastructure (customer-facing deployments)
- Ability to navigate ambiguous setups and translate technical systems into usable workflows
What We Do
Lexoga is an AI-driven platform focused on revolutionizing engineering recruitment. Through its Lexoga One solution, the company helps early-stage and high-growth startups identify and hire exceptional engineering and AI talent, serving as an AI agent for founding engineer hiring. Lexoga leverages AI-powered tools and solutions to innovate the future of work and streamline the process of building high-performing technical teams.
