Founding Senior Applied AI Engineer

Posted Yesterday
Be an Early Applicant
Palo Alto, CA, USA
In-Office
Senior level
Artificial Intelligence • Machine Learning • Software • Generative AI
The Role
Build and operate production agent infrastructure, including agent harnesses, sandboxed execution environments, context systems, observability, evaluation suites, and model-routing systems. Work directly with customers to turn prototypes into reliable products, then use production traces to improve environments, reward signals, and models. Own technical decisions across agent reliability, cost, latency, security, and scale in a founding startup role.
Summary Generated by Built In
About us

We’re building toward a world where every company can become its own AI lab.
Goaly is a stealth AI startup founded by ex-Meta Superintelligence Labs engineers and researchers. Our mission is to dramatically lower the cost, time, and talent barriers to building proprietary AI — and make each generation of models faster and cheaper to build than the last.

Backed by leading AI investors and endorsed by frontier AI researchers and builders, we’re looking for exceptional new grads who want to work on hard, foundational AI systems problems with outsized ownership from day one.

About the role

You will be one of the first engineers building the layer between frontier models and real users: the agent harness. That means the loop, the tools, the context, the sandbox the agent runs in, and the evals that tell us whether it actually works. You will ship this into production for real customers, then turn what we learn from those runs into better environments, better evals, and better models.

This is a founding role. There is no playbook yet; you help write it. You will own problems end to end, from the first prototype with a customer to a system that runs thousands of agent rollouts a day without anyone watching it.

What you'll do
  • Own the harness: the agent loop, tool interface, system prompts, permissions, stop conditions, retries, budget caps, and output checks that turn a model into a dependable agent.

  • Build sandboxed execution environments (containers / microVMs) that are isolated, reproducible, and fast enough to run thousands of rollouts in parallel, used both for serving and for RL and evals.

  • Design context engineering: what goes into the window, when to compact, file-backed memory and state, retrieval, and hand-offs between sub-agents on long-running tasks.

  • Make every agent run observable and replayable: trace every model call, tool call, and state change, so a failure at 3am can be reproduced at 9am.

  • Build the eval stack: offline suites, tests on production traces, LLM-as-judge, and checks that catch reward hacking and silent failures before they poison training data.

  • Ship with customers: embed with real users, take a workflow from prototype to stable production, and turn repeated patterns into reusable building blocks (tools, MCP servers, agent skills, playbooks).

  • Close the loop with research: convert production traces and failures into tasks, environments, and reward signals for post-training.

  • Make the model calls: pick which model runs where, and own the cost, latency, and quality trade-offs.

You may be a good fit if you have
  • 5+ years building production software, with real experience running systems at scale (many users, high request volume, on-call scars).

  • Built and shipped an agentic system with tool use that real users depend on, and debugged it when it broke.

  • First-hand experience with the failure modes: context overflow, agents looping, tool misuse, prompt injection, runaway cost.

  • Strong Python plus at least one of TypeScript, Go, or Rust; comfortable with Docker, Linux, and cloud infrastructure.

  • A habit of building your own evals instead of trusting public benchmarks; you measure before you claim.

  • A strong pull toward the simplest system that works, and a low tolerance for complexity that does not earn its keep.

  • Comfort operating without a playbook, in ambiguity, and being wrong quickly in front of customers.

  • The ability to explain trade-offs clearly to engineers, researchers, and customers.

Strong pluses
  • Experience building agent platforms, workflow systems, model-serving products, ML infrastructure, or other developer-facing AI systems.

  • Experience with multi-tenant control planes, identity and access management, metering or billing, enterprise security, or high-throughput APIs.

  • Familiarity with LLM inference, fine-tuning, evaluation, tool use, sandboxes, or the operational lifecycle of production agents.

  • Experience owning open-source SDKs, developer tools, API documentation, examples, or community-facing integrations.

  • Full-stack ability and an eye for interaction design when a product problem requires work beyond the backend.

How we work
  • Mission first. We choose work for its impact on the mission and take responsibility for the outcome, not just our assigned tasks.

  • High agency. We identify what is missing, form a plan, and move without waiting for perfect clarity.

  • Speed with rigor. We ship, measure, and iterate quickly while protecting correctness, safety, and reliability.

  • Flexible scope. We cross team and technical boundaries when that is the fastest way to solve the real problem.

  • Low ego, high standards. We give direct feedback, change our minds when the evidence changes, and help the whole team win.

  • Continuous learning. The stack changes quickly; we are willing to learn unfamiliar systems, methods, and domains as the work demands.

Location, visa sponsorship & benefits

  • Hybrid in Palo Alto: 4+ days/week in office.

  • Visa sponsorship: H-1B and OPT/CPT support available, with immigration counsel.

  • Meals & perks: Complimentary lunch, dinner, snacks, and drinks.

A note on qualifications. We value exceptional ability over perfect keyword matches. If the work excites you and you can show strong technical ability, learning speed, or ownership, we encourage you to apply.

Equal opportunity

We are an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, genetic information, or any other characteristic protected by applicable law. We provide reasonable accommodations for candidates who need them during the hiring process.

Skills Required

  • 5+ years building production software
  • Experience running systems at scale with many users and high request volume
  • Built and shipped an agentic system with tool use that real users depend on
  • Experience debugging production agent failures
  • Strong Python proficiency
  • Proficiency with at least one of TypeScript, Go, or Rust
  • Comfort with Docker, Linux, and cloud infrastructure
  • Experience building custom evaluations rather than relying solely on public benchmarks
  • Ability to work independently in ambiguous environments
  • Ability to explain trade-offs clearly to engineers, researchers, and customers
  • Experience with agent platforms, workflow systems, model-serving products, ML infrastructure, or developer-facing AI systems
  • Experience with multi-tenant control planes, identity and access management, metering or billing, enterprise security, or high-throughput APIs
  • Familiarity with LLM inference, fine-tuning, evaluation, tool use, sandboxes, or production-agent operations
  • Experience owning open-source SDKs, developer tools, API documentation, examples, or community integrations
  • Full-stack ability and interaction-design skills
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
80 Employees
Year Founded: 2025

What We Do

Goaly is building AI systems and a platform that make custom, domain-specific AI more affordable for every business. Its work spans model post-training, reinforcement-learning infrastructure, large-scale training, reliable inference, and product engineering. The company aims to help enterprises achieve strong task performance at a fraction of typical costs, while developing agents that can reason, use tools, and complete meaningful real-world work.

Similar Jobs

Puntt.ai Logo Puntt.ai

Artificial Intelligence Engineer

Artificial Intelligence • Marketing Tech • Automation
Hybrid
San Francisco, CA, USA
11 Employees
185K-210K Annually

Relativity Space Logo Relativity Space

Controls Engineer

Aerospace • Hardware • Robotics • Software • Manufacturing
Easy Apply
In-Office
Long Beach, CA, USA
2200 Employees
124K-186K Annually

Adyen Logo Adyen

Senior Compliance Officer

Fintech • Payments • Financial Services
Easy Apply
Hybrid
San Francisco, CA, USA
4771 Employees
180K-230K Annually

2K Logo 2K

Development Manager

Gaming • Information Technology • Mobile • Software • Esports
Hybrid
San Mateo, CA, USA
4200 Employees
104K-154K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account