Principal Engineer - Architect (AI Agents)

Posted 5 Days Ago
Be an Early Applicant
11 Locations
Remote
Senior level
Information Technology • Software
The Role
Own end-to-end architecture and technical direction for a production AI agent platform: build agent runtime, cloud infrastructure, eval harness, deployment/monitoring/recovery, and lead engineering, mentorship, and client-facing direction.
Summary Generated by Built In
About DevSavant

DevSavant is an operating partner for startups and growth-stage companies, helping them turn ambition into execution.

We support founders and leadership teams with product engineering and global staffing, from early prototypes and MVPs to scaling high-performing teams. Our vetted talent across LATAM and Asia embeds directly into client teams, operating as true extensions rather than external vendors.

With over 8 years working in venture-backed ecosystems, DevSavant is trusted to accelerate delivery, scale teams efficiently, and support companies as they reach their next milestone.

About the Role

We're looking for a Principal Engineer / Architect in AI Agents to own the architecture and technical direction of our AI agent platform end to end. This role sits at the intersection of deep systems engineering and frontier AI — you'll design the agent runtime, own the cloud infrastructure that runs it, build the evaluation harness that measures quality, and set the technical bar for a small but growing team. You'll be the operational and architectural center of gravity for a platform built to run AI agents reliably in front of real clients.

We run AI agents in production, and this role is how we make them excellent. If you're energized by the challenge of building systems that are robust, scalable, and observable enough to hold up under real conditions — and you want full ownership over a platform reshaping how agents are built and deployed — this is the role for you.

You will report directly to the Founder. This is a remote/hybrid role, and we are looking for candidates who bring fluent, polished, client-facing professional English.

Key Responsibilities
  • Own the system architecture end to end — agent runtime, infrastructure, and delivery — including all trade-offs and design decisions, with no architect above you to defer to.

  • Drive the engineering that makes our agents robust, scalable, and observable enough to run reliably in front of clients; treat quality as a product surface, not an afterthought.

  • Build and maintain the eval harness that determines whether an agent is actually good — designing offline and online evaluations, LLM-as-judge scoring, and closing the loop between measurement and improvement.

  • Own how live agents are deployed, monitored, and recovered — including catching silent failures and ensuring full observability across the agent stack.

  • Set technical direction: bring proposals, decide what moves next, and drive the engineering roadmap in close partnership with the Founder.

  • Review work, mentor engineers, and grow the team as the platform scales — shipping low-risk decisions independently and bringing weight-bearing ones to the table.

Required Qualifications
  • 7+ years of experience in software engineering, systems architecture, or a closely related discipline — with meaningful, production-grade time spent building and operating AI agent systems.

  • Agent-harness mastery is the core of this role. You've built, deployed, and operated agents on real harnesses in production — not in demos. You have working knowledge of OpenClaw and Hermes at the architectural and internals level: enough to extend, debug, and push them past their defaults. You're pragmatic about reaching for whichever harness fits the problem.

  • Fluent across the full agentic stack — tool and prompt orchestration, multi-agent workflows, function calling and structured outputs, RAG and agent memory, MCP, and multi-provider LLM integration — and you know the failure modes unique to agents: loops, silent stalls, context drift, tool misuse.

  • You treat evals as first-class engineering. You can design and implement evaluation frameworks, reason rigorously about agent quality, and instrument agents with proper tracing and monitoring.

  • Strong cloud and infrastructure depth — you've owned full systems from a blank page and designed for scale, reliability, security, and cost across AWS, GCP, or Azure, with solid command of containers, orchestration, infrastructure-as-code, and multi-tenant architecture.

  • A real DevOps / SRE backbone: live ownership, incident response, root-cause analysis, and distributed-systems instincts. You build production-grade systems that are scalable, fail-loud, and cost-aware — not impressive demos.

  • Strong leadership and judgment — you set direction, decompose ambiguity, mentor strong engineers, and communicate clearly enough to be trusted in front of clients.

Bonus
  • You track the agent and LLM space obsessively — a new harness or model lands and you're already trying it.

  • You have experience with Go for infrastructure or systems work.

  • You've worked with local inference tooling such as Ollama or vLLM.

How We Operate

High autonomy, low overhead. We ship production-grade work fast, keep decisions close to the people doing the work, and pull in oversight only where it genuinely matters. If you do your best work when you own the problem and the bar is high, you'll fit here.

Skills Required

  • 7+ years of experience in software engineering, systems architecture, or a related discipline with production-grade experience building and operating AI agent systems
  • Proven experience building, deploying, and operating agents in production; agent-harness mastery with working knowledge of OpenClaw and Hermes internals
  • Fluent across the agentic stack: tool and prompt orchestration, multi-agent workflows, function calling, structured outputs, RAG, agent memory, MCP, and multi-provider LLM integration
  • Design and implement evaluation frameworks, including offline and online evaluations and LLM-as-judge scoring; instrument agents with tracing and monitoring
  • Strong cloud and infrastructure experience across AWS, GCP, or Azure; experience with containers, orchestration, infrastructure-as-code, and multi-tenant architecture
  • DevOps / SRE experience: live ownership, incident response, root-cause analysis, distributed-systems instincts, and building production-grade, cost-aware systems
  • Ownership of deployment, monitoring, and recovery for live agents, including detecting silent failures and ensuring full observability
  • Strong leadership, judgment, mentorship skills, and polished client-facing English communication
  • Experience with Go for infrastructure or systems work
  • Experience with local inference tooling such as Ollama or vLLM
  • Active interest in and continual tracking of the agent and LLM space (trying new harnesses and models)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Mateo, California
93 Employees
Year Founded: 2020

What We Do

DevSavant provides comprehensive technology solutions to Savant Growth's portfolio companies. Our data scientists and developers are experts in the fields of data analytics, software development, and AI. DevSavant’s engineers work across the spectrum of full-stack technology solutions for the B2B SaaS industry, helping you growing company tackle its toughest challenges and giving you the freedom to focus on what matters most, the future of your business

Similar Jobs

Circle (circle.so) Logo Circle (circle.so)

Senior Site Reliability Engineer

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Easy Apply
Remote
31 Locations
250 Employees
130K-140K Annually

CodePath.org Logo CodePath.org

Senior Product Designer

Edtech • Social Impact
Easy Apply
Remote
37 Locations
55 Employees
148K-190K Annually
Easy Apply
Remote
37 Locations
55 Employees
140K-178K Annually

InterSystems Logo InterSystems

Executive Assistant

Artificial Intelligence • Big Data • Healthtech • Machine Learning • Software • Database • Analytics
Easy Apply
Remote
Chile
2407 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account