Be an Early Applicant
UP.Labs is a first-of-its-kind venture lab unlocking the future of transportation and mobility.
The Role
Lead the design, build, and production deployment of agentic LLM systems that take real-world actions. Own agent architecture, retrieval/grounding, graph-backed knowledge, eval harnesses, observability, approvals/rollback, and team growth while partnering with applied science for embeddings and vector stores.
Summary Generated by Built In
Overview
Technical Challenge
Responsibilities
Required Skills
Preferred Skills
UP.Labs Summary
Location: Remote
UP.Labs is a dynamic venture studio dedicated to building innovative startup companies from the ground up. Our team thrives on solving complex problems, driving technological advancements, and creating impactful digital products. We're seeking a highly skilled professional to join our growing team and contribute to our mission of launching the next wave of successful startups.
Technical Challenge
We're building an agentic system as the core delivery mechanism for one of our ventures, and we're looking for a production agent-systems engineer who will own and grow the agentic function end-to-end — not a notebook builder or an ML researcher. You'll design the architecture for agents across the business, ground them in a complex proprietary domain through strong context and retrieval engineering, and build systems that take real action for real users, not just chatbots.
Responsibilities
- Own and grow the agentic function end-to-end: set architecture across internal (data-engineering & data-science agents) and external (customer/partner-facing agents, MCP servers) surfaces, make build-vs-buy calls, and grow a team under you as we scale.
- Design, build, and deploy production LLM agents that take consequential action (write-back, execute changes) with human-in-the-loop controls — including tool interfaces (MCP, function calling), tiered tool access, approval gates, and rollback.
- Build and maintain eval harnesses for agentic systems — offline and online evaluation, regression testing for non-determinism, guardrails, and observability/tracing.
- Own context and retrieval engineering: go beyond naive chunking to build high-quality retrieval, context assembly, and grounding in proprietary domain data to reduce hallucination.
- Implement graph-based knowledge and retrieval systems (GraphRAG, property graphs, ontology/semantic layers) to ground agents in a complex, structured domain.
- Partner with applied science and the broader data/ML function on pipelines, embeddings, and vector stores where relevant, without owning ML model training.
- Communicate agent architecture, trade-offs, and roadmap to execs and investors; act as a player-coach who writes production code today while owning the function's direction and hiring as the team grows.
Required Skills
- 5+ years shipping production software; strong full-stack/backend engineering (Python core, TS/Node or Go a plus), including production APIs, data models, testing, and CI.
- Proven track record building and shipping LLM agents to production with real users — multi-step, tool-calling, stateful, with orchestration (LangGraph or equivalent) — and the ability to explain the control loop, not just the framework used.
- Experience building eval harnesses for agentic systems (e.g. MLflow, LangSmith, or custom) with fluency in determinism, drift, and guardrails.
- Experience owning a retrieval system in production, including chunking vs. structured retrieval trade-offs and evaluating retrieval quality.
- Experience shipping agents that take consequential, real-world action, with a clear point of view on approval/guardrail/rollback architecture (bonus: an incident where the agent did the wrong thing, and how it was handled).
- Track record leading an agentic initiative or team end-to-end — from architecture to production — including communicating agent systems to both execs and investors.
Preferred Skills
- Experience shipping graph-backed retrieval and explaining why graphs outperform flat vectors for structured domains (GraphRAG, knowledge graphs, ontologies, property graphs, triple stores).
- Experience fine-tuning or distilling an open-source model (LoRA/QLoRA) with measured gains, or strong context/prompt optimization as a substitute.
- Experience serving/operating open-source models (Llama, Qwen, Mistral) via Databricks, vLLM, or similar, with a point of view on self-host vs. hosted-API cost/latency trade-offs.
UP.Labs Summary
We build high-growth technology startups that enable faster, cleaner, and safer movement of people and goods. Our vision is to transform the moving world by pairing leading corporations and entrepreneurs with a proven methodology for launching and scaling software and hardware companies.
We work with corporate investors over a multi-year period to launch a portfolio of mobility-focused ventures. Our team is dedicated to the first year of a new venture's life cycle, from ideation to minimum viable product build (and beyond) to recruiting and hiring the full-time team who will scale the business.
Location: Remote
Skills Required
- 5+ years shipping production software with strong full-stack/backend engineering
- Proficiency with Python (core); TypeScript/Node or Go a plus
- Proven track record building and shipping LLM agents to production (multi-step, tool-calling, stateful, orchestration such as LangGraph or equivalent)
- Experience building eval harnesses for agentic systems (MLflow, LangSmith, or custom) and handling determinism, drift, and guardrails
- Experience owning a production retrieval system and evaluating retrieval quality (chunking vs structured retrieval trade-offs)
- Experience shipping agents that perform consequential actions with approval gates, rollback, and human-in-the-loop controls
- Track record leading an agentic initiative or team end-to-end, including communicating architecture and roadmap to execs/investors
- Experience with graph-backed retrieval / knowledge graphs / GraphRAG (preferred)
- Experience fine-tuning or distilling open-source models (LoRA/QLoRA) or strong prompt/context optimization (preferred)
- Experience serving/operating open-source models (Llama, Qwen, Mistral) via Databricks, vLLM, or similar (preferred)
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
We work with global corporate partners to identify the most pressing challenges that they, and broader society, face. Inspired by these complex problems, we launch startups built by proven entrepreneurs, product leaders and technologists that use their agility and talent to develop transformative solutions. After these companies have matured and proven market fit, our corporate partners are able to acquire them, reaping strategic value while enriching their culture and core business. We believe this to be the shortest road to a faster, cleaner, safer, and more accessible future.
Why Work With Us
We launch and innovate 6-8 portfolio organizations a year where no day is the same.
Gallery
