Robots & Pencils
Teams at Robots & Pencils
Recently posted jobs
Information Technology • Design
Build and deploy large-scale LLM-based recommender systems from raw customer and catalog data through production inference. Responsibilities include feature and context engineering, distributed training on SageMaker HyperPod, LoRA/QLoRA fine-tuning, reinforcement learning, deep learning architecture, ranking, inference optimization, evaluation, privacy protection, and stakeholder communication with Expedia and AWS science teams.
Information Technology • Design
Lead development of a production-grade evaluation framework for planner-executor agents. Build user simulation, isolated experiment execution, grading, statistical analysis, tracing, optimization-lever plugins, and a locally hosted dashboard. Run experiments comparing models and inference strategies, quantify quality, latency, and cost tradeoffs, generate evidence-backed insights, and deliver client recommendations. Partner with engineers and business stakeholders, communicate findings, establish evaluation standards, and mentor others.
Information Technology • Design
Lead the design and implementation of a production-grade evaluation framework for planner-executor AI agents. Build simulation, experiment execution, grading, statistical analysis, tracing, optimization-lever plugins, and a locally hosted dashboard. Partner directly with enterprise clients to run staged campaigns, quantify cost-quality tradeoffs, project dollar impact, assess generalization, and deliver evidence-based recommendations. Provide technical leadership, establish evaluation standards, mentor engineers, and communicate findings to technical and business stakeholders.
