Staff AI Engineer, Agentic Automation

Posted 14 Hours Ago
Hiring Remotely in United States
Remote
Expert/Leader
Information Technology • Cybersecurity
The Role
Own Cerby’s AI agents for API catalog generation, browser workflow creation, and self-healing automation. Take existing systems into production using durable workflows, observability, evaluation benchmarks, cost controls, and security protections. Responsibilities include detecting and repairing automation drift, managing credential isolation and prompt-injection risks, defining threat models, partnering with engineering teams, writing design documentation, mentoring contributors, and providing on-call ownership after launch.
Summary Generated by Built In

About Cerby


At Cerby, security is everyone's business.

Cerby extends your security perimeter to include your disconnected applications, providing identity automation and eliminating manual processes. It's one of the biggest blind spots in enterprise security, and we're the team closing it. If you want to work alongside the team solving one of the hardest, most overlooked problems in security, you're in the right place.
Founded in 2020, Cerby is backed by leading investors and trusted by enterprises across the globe.


OVERVIEW & IMPACT

Every application Cerby protects needs Cerby to know how it works — its API, or the clicks behind its login, password rotation, MFA setup, or access change — and that knowledge breaks whenever a vendor redesigns its site or changes its API. We are looking for a Staff AI Engineer to own the AI agents that onboard new applications and repair automations when they drift. You will start with two agent systems we have already built and benchmarked:

API catalog generation: reads a vendor’s public API docs in a headless browser and produces a validated OpenAPI spec, with per-job cost ceilings and an accuracy benchmark.

Browser workflow generation: performs a task in a SaaS app’s web UI and writes a replayable automation workflow, handling MFA, one-time codes, and CAPTCHAs along the way.

Your job is to take them to production, make them self-healing, and set the direction for agentic automation at Cerby. These agents handle real customer credentials and browse untrusted sites, so security is part of the job, not an afterthought.


KEY RESPONSIBILITIES

Ownership and Production
  • Own agentic onboarding and self-healing end to end: architecture, roadmap, and on-call once live.
  • Take the existing systems to production on durable workflows (Temporal), with the observability to run them.
Self-Healing Automation
  • Detect drift — a changed login page, a moved button, a renamed API field — from failed runs, before customers notice.
  • Build agents that diagnose the break, repair the workflow or spec, and re-validate the fix against real runs before it goes back into service.
  • Decide what heals automatically and what needs human review.
Evaluation and Cost
  • Own the benchmarks for generated specs, workflows, and repairs, and make “good enough to ship” a measured threshold.
  • Own cost and latency per output, choosing between frontier and open-weight models on measured accuracy versus cost.
Security
  • Own the threat model: prompt injection from page content, credential isolation, token handling, sandboxed browsing, and egress.
  • Keep credentials out of prompts, logs, queues, and stored run state.
Collaboration
  • Partner with the integrations, automation-runtime, and platform teams; write the design docs they build on, and mentor contributors.
QUALIFICATIONS & REQUIRED SKILLSExperience
  • You have shipped an LLM agent with tool use that ran unattended for real users, and owned a backend system in production.
Technical Skills
  • Strong in Python or TypeScript, and productive in both.
  • LLM agents and tool use: agent loops, structured outputs, retries, and the failure modes they create.
  • Eval discipline: you have built benchmarks or eval harnesses and used them to make decisions.
  • Depth in browser automation (Playwright or similar) or backend and API-integration systems, and comfort in the other.
  • Distributed systems: queues, idempotency, and durable workflow engines (Temporal, Step Functions, or similar).
  • Security judgment for systems that handle secrets, including agent-specific threats such as prompt injection.
Desirable
  • Temporal in production; Pydantic AI or a comparable agent framework.
  • Open-weight model serving (Fireworks, Together, Bedrock) and LLM cost modeling.
  • Computer-use agents or browser extensions (Chrome MV3); OpenAPI tooling.
  • Identity, IAM, or credential-management experience; AWS and Terraform.
Soft Skills
  • Clear technical writing and trade-offs other teams can depend on.
  • You take an early system to production without waiting to be told how, and care that it keeps working after launch.
WHAT SUCCESS LOOKS LIKE
  • 6 months: both systems run in production for real workloads, with improving error rates and cost per output, and drift is detected automatically.
  • 12 months: onboarding a new application is predominantly automated, and most drift-driven breakages heal without a human.

Skills Required

  • Experience shipping an LLM agent with tool use that operated unattended for real users
  • Experience owning a backend system in production
  • Strong Python or TypeScript skills, with productivity in both
  • Experience with LLM agents, agent loops, structured outputs, retries, and agent failure modes
  • Experience building benchmarks or evaluation harnesses
  • Depth in browser automation such as Playwright or backend and API integration systems, with comfort in the other area
  • Distributed systems experience, including queues, idempotency, and durable workflow engines
  • Security judgment for systems handling secrets, including prompt-injection threats
  • Clear technical writing and ability to document trade-offs
  • Ability to take early systems to production and maintain reliability after launch
  • Production experience with Temporal
  • Experience with Pydantic AI or a comparable agent framework
  • Open-weight model serving using platforms such as Fireworks, Together, or Bedrock
  • LLM cost modeling experience
  • Experience with computer-use agents or browser extensions such as Chrome MV3
  • OpenAPI tooling experience
  • Identity, IAM, or credential-management experience
  • AWS and Terraform experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Alameda, CA
113 Employees
Year Founded: 2020

What We Do

Cerby is the only identity security platform built for disconnected apps, providing IT and Security teams with full control over apps that lack APIs or support for protocols like SAML or SCIM. Seamlessly integrating with your central identity provider, Cerby extends critical security automations—such as SSO, MFA, and lifecycle management—to any app without incurring the costly “SSO tax.” With Cerby, teams can automate essential tasks like user deprovisioning and password rotations, reducing manual work while closing security gaps. With Cerby, your team can: ✔ Centralize and automate access controls for disconnected apps ✔Securely share access to corporate social media accounts ✔ Streamline lifecycle management for apps without APIs or SCIM ✔ Automate deprovisioning and password rotations for shared privileged accounts ✔ Instantly detect app sprawl and make IT-approved suggestions to control costs and proliferation Get a demo to see us in action: www.cerby.com/demo

Similar Jobs

Halter Logo Halter

Territory Manager (Oklahoma)

Greentech • Hardware • Internet of Things • Machine Learning • Software • Business Intelligence • Agriculture
Remote
Oklahoma, USA
350 Employees
120K-160K Annually

Datadog Logo Datadog

Sales Executive

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Texas, USA
6500 Employees
98K-130K Annually

Northwestern Mutual Logo Northwestern Mutual

Principal, Talent Management

Fintech • Insurance • Financial Services
Remote or Hybrid
Milwaukee, WI, USA
8400 Employees
131K-226K Annually

PNC Bank Logo PNC Bank

Cloud Security Engineer

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees
91K-203K Annually

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account