Staff Software Engineer, AI Platform (San Francisco)

Posted 17 Hours Ago
Be an Early Applicant
San Francisco, CA, USA
Hybrid
220K-260K Annually
Expert/Leader
Software
Pioneering the Agentic Data Plane, powered by multi-modal data streaming. Connect, query, & govern for AI/realtime apps.
The Role
Architect, build, and operate Redpanda’s Agentic Data Plane and cloud services across AWS, GCP, and Azure. Lead large technical projects, define architecture, develop automated provisioning and self-healing systems, and ensure reliability, scalability, security, observability, and zero-downtime upgrades. Participate in on-call operations, mitigate technical risks, and collaborate across engineering, product, and customer-facing teams.
Summary Generated by Built In

Redpanda is the first runtime and control plane for agent-data interaction — a unified platform that combines streaming, SQL analytics, and intelligent connectivity with the governance layer enterprise AI agents need in production.

Built on infrastructure already trusted by Fortune 500 companies and fast-growing startups, Redpanda enforces governance entirely outside the agent's data path, controlling what agents see, limiting what they do, and capturing a tamper-proof record of everything they touch, so organizations never have to choose between innovation and control.

About the Role:

We’re looking for an experienced Staff Software Engineer to help architect and build the systems that power Redpanda’s vision for the Agentic Data Plane (ADP), while also shaping the technical culture behind them.

In this role, you will design and develop our ADP product, building on our Bring Your Own Cloud, Serverless, and Redpanda Connect offerings. You will lead system architecture, develop new features, and operate ADP and Redpanda Cloud, helping us meet our 99.99% SLA. You will raise the engineering bar across the Cloud team and collaborate closely with Cloud, Core, and Platform engineering, as well as pre- and post-sales teams, to build robust, scalable systems with a strong emphasis on stability and zero-downtime upgrades.

This is a hybrid role based in our San Francisco office.

You Will: 

  • Design, build and operate ADP and cloud services across AWS, GCP, and Azure, including control plane and data plane components

  • Convert ambiguous product requirements into clear technical designs and executable workstreams

  • Lead the technical direction of large projects within ADP, and contribute to architecture discussions that span ADP and adjacent Cloud teams

  • Anticipate technical risks and proactively mitigate them to ensure timely, high quality delivery

  • Set and uphold high standards for reliability, scalability, performance, and security

  • Identify and champion new features, process improvements, and strategic initiatives that enhance engineering culture and operational excellence

  • Participate in the on-call escalation chain; helping reduce escalations and improve operational health

  • Build tools and services for automated infrastructure provisioning, deployment, and self-healing

  • Make resilience and observability integral to the systems you own, enabling us to run enterprise-grade agentic systems and service in the cloud

You Have:

  • Significant experience designing and operating  large-scale, reliable systems in public cloud environments

  • A track record of leading large technical projects end-to-end, from design and planning, to execution and production operations

  • Strong proficiency in Go (or comparable systems language with willingness to ramp)

  • Experience with AI-assisted software development workflows including tools like Claude Code

  • Production experience with Kubernetes, including running and operating workloads 

  • Working knowledge of at least one of AWS / Azure / GCP, including IaC for system and network infrastructure

  • Familiarity with stream processing concepts

  • Excellent written and verbal communication skills; comfortable working in a globally distributed, async environment (e.g., GitHub)

  • Ability to collaborate effectively with engineering, product, and customer-facing stakeholders 

Nice to Have:

  • Experience building Kubernetes operators for stateful / storage workloads

  • Experience building or operating SaaS platforms

  • Experience with streaming platforms as a user or provider

  • Exposure to production agentic systems and building agentic workflows

 

U.S. base salary range for this role is $220,000 - $260,000.Our salary ranges are determined by role, level, and location. We strive to consider each candidate's job-related skills, location, experience, relevant education or training to determine individual base salary. Your talent partner will share more about the specific salary range for your preferred location during the hiring process.

Join Redpanda if you’d enjoy being part of a fast-moving, diverse, people-first organization with team members around the globe and a culture based on trust, transparency, communication, and kindness. You'll dive into a nimble, high-impact team with the latest AI tools — and the budget to actually use them.

Skills Required

  • Significant experience designing and operating large-scale, reliable systems in public cloud environments
  • Experience leading large technical projects end-to-end, including design, planning, execution, and production operations
  • Strong proficiency in Go or a comparable systems programming language, with willingness to ramp up on Go
  • Experience with AI-assisted software development workflows, including tools such as Claude Code
  • Production experience with Kubernetes, including running and operating workloads
  • Working knowledge of at least one of AWS, Azure, or GCP, including infrastructure as code for system and network infrastructure
  • Familiarity with stream processing concepts
  • Excellent written and verbal communication skills
  • Ability to work effectively in a globally distributed, asynchronous environment
  • Ability to collaborate effectively with engineering, product, and customer-facing stakeholders
  • Experience building Kubernetes operators for stateful or storage workloads
  • Experience building or operating SaaS platforms
  • Experience with streaming platforms as a user or provider
  • Exposure to production agentic systems and agentic workflows
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
197 Employees
Year Founded: 2019

What We Do

Redpanda is pioneering the Agentic Data Plane (ADP) - a new category in AI infrastructure that makes it simple and secure to connect AI agents with enterprise data and systems. Built on a multi-modal data streaming engine, Redpanda empowers agentic applications that reason and act in real-time with speed, autonomy, and precision. Global leaders including Activision Blizzard, Cisco, Moody's, Texas Instruments, Vodafone and 2 of the top 5 banks in the U.S. rely on Redpanda to process hundreds of terabytes of data a day. Backed by premier venture investors Lightspeed, GV and Haystack VC, Redpanda is a diverse, people-first organization with teams distributed around the globe.

Why Work With Us

We are a fully remote, diverse and inclusive team of doers, seasoned engineers, hackers, and builders, working on the future of streaming data and agentic applications. We’re committed to fostering an inclusive, innovative environment where every team member can grow, thrive, and make a real impact.

Gallery

Gallery

Similar Jobs

SpaceX Logo SpaceX

Software Engineer

Aerospace • Other
In-Office
Palo Alto, CA, USA
8879 Employees
135K-185K Annually

ServiceNow Logo ServiceNow

Enterprise Account Exec., Federal (Armis)

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
La Canada, CA, USA
29000 Employees
68K-175K Annually

ServiceNow Logo ServiceNow

Director, Data Strategy & Services

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
29000 Employees
173K-238K Annually

Block Logo Block

Test Engineer

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
139K-245K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account