Principal Engineer - Agentic Data Plane

Posted 3 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
245K-290K Annually
Expert/Leader
Software
Pioneering the Agentic Data Plane, powered by multi-modal data streaming. Connect, query, & govern for AI/realtime apps.
The Role
The Principal Software Engineer will lead the architecture and development of Redpanda's Agentic Data Plane, focusing on integrating AI agents with enterprise data, improving system observability, and engaging with strategic customers.
Summary Generated by Built In
Redpanda is pioneering the Agentic Data Plane (ADP) - a new category in AI infrastructure that makes it simple and secure to connect AI agents with enterprise data and systems. Built on a multi-modal data streaming engine, Redpanda empowers agentic applications that reason and act in real-time with speed, autonomy, and precision.
Global leaders including Activision Blizzard, Cisco, Moody's, Texas Instruments, Vodafone and 2 of the top 5 banks in the U.S. rely on Redpanda to process hundreds of terabytes of data a day.
Backed by premier venture investors Lightspeed, GV and Haystack VC, Redpanda is a diverse, people-first organization with teams distributed around the globe.
 

About the Role:

We're looking for a Principal Software Engineer to help architect and build Redpanda's Agentic Data Plane (ADP), the control and execution layer that powers how AI agents safely interact with real-world data across the technological sprawl of the modern enterprise. Redpanda’s Agentic Data Plane enables intelligent agents to autonomously access, reason over, and act on enterprise data in real time, while providing their human counterparts with the visibility and control to ensure and validate that they do so securely. It combines Redpanda’s industry-leading low-latency streaming layer, a distributed query engine for real-time context, 300+ connectors for seamless data integration, and a global policy and observability framework that enforces access, records intent, and enables replayable audits.

You'll work on identifying and integrating the next generation of ADP capabilities as the agentic AI landscape evolves, translating emerging research and industry shifts into concrete engineering proposals and product bets. You'll partner closely across Engineering, with our Product and GTM teams, as well as directly with strategic customers to shape the product’s architecture and direction

You Will:  

  • Track emerging research, frameworks, and industry developments in the agentic AI space, and translate the most relevant signals into concrete engineering proposals and product bets
  • Identify, prototype, and deliver high-leverage emerging capabilities for ADP, in partnership with the broader team 
  • Define architectural patterns for new ADP capabilities, ensuring they integrate cleanly with the existing runtime, policy, and observability layers
  • Engage directly with strategic customers and the field to stress-test new capabilities against real enterprise deployment scenarios
  • Serve as a technical ambassador for ADP externally, publishing research, writing engineering blog posts, and speaking at conferences to establish Redpanda's credibility at the frontier of agentic infrastructure
  • Participate in on-call and help drive down operational toil, improving system observability and self-healing capabilities over time

You Have: 

  • 10+ years of software engineering experience, with a demonstrated track record of leading the design and delivery of complex, large-scale distributed systems
  • Experience building or contributing to emerging areas of agentic AI infrastructure, e.g. eval frameworks, orchestration layers, context management, AI gateways, or similar
  • Fluency with AI-assisted development at the level of agentic orchestration, i.e. composing multi-agent coding workflows with subagents to dramatically accelerate research and prototyping
  • Deep expertise in at least one systems language (Go preferred) and comfort working across the stack
  • Understanding of streaming data systems, messaging infrastructure, or data plane/control plane architectures, experience with Apache Kafka or Redpanda is a plus
  • Experience designing and operating systems that enforce access control, policy, and auditability at scale 
  • Self-directed, strong written communicator, comfortable collaborating asynchronously in GitHub, Slack, and Google Docs
  • Excellent interpersonal and communication skills. Able to lead without authority across engineering teams and engage credibly with technical customers and external audiences

Nice to Have:

  • Familiarity with AI safety, alignment, or responsible AI research as it applies to autonomous systems in enterprise environments
  • Experience with protocol buffers, protoreflect and codegen
  • Background in security, identity, or data governance systems relevant to enterprise environments
  • Experience running Kafka/Redpanda and/or Postgres at scale
  • Experience with Kubernetes and cloud-native infrastructure across AWS, GCP, or Azure
  • Prior experience in an early-stage or growth-stage startup, especially in a category-defining product area

U.S. base salary range for this role is $245,000 - $290,000. Our salary ranges are determined by role, level, and location. As a remote-first company, we strive to consider each candidate's job-related skills, location, experience, relevant education or training to determine individual base salary. Your talent partner will share more about the specific salary range for your preferred location during the hiring process.

Join Redpanda if you’d enjoy being part of a fast-moving, diverse, people-first organization with team members around the globe and a culture based on trust, transparency, communication, and kindness.

                                                                                                                                                                                                                                                           #LI-Remote
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
197 Employees
Year Founded: 2019

What We Do

Redpanda is pioneering the Agentic Data Plane (ADP) - a new category in AI infrastructure that makes it simple and secure to connect AI agents with enterprise data and systems. Built on a multi-modal data streaming engine, Redpanda empowers agentic applications that reason and act in real-time with speed, autonomy, and precision. Global leaders including Activision Blizzard, Cisco, Moody's, Texas Instruments, Vodafone and 2 of the top 5 banks in the U.S. rely on Redpanda to process hundreds of terabytes of data a day. Backed by premier venture investors Lightspeed, GV and Haystack VC, Redpanda is a diverse, people-first organization with teams distributed around the globe.

Why Work With Us

We are a fully remote, diverse and inclusive team of doers, seasoned engineers, hackers, and builders, working on the future of streaming data and agentic applications. We’re committed to fostering an inclusive, innovative environment where every team member can grow, thrive, and make a real impact.

Gallery

Gallery

Similar Jobs

Mastercard Logo Mastercard

Principal Software Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
San Carlos, CA, USA
38800 Employees
212K-407K Annually

Mastercard Logo Mastercard

Principal Software Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
San Francisco, CA, USA
38800 Employees
170K-281K Annually

Cox Enterprises Logo Cox Enterprises

Client Integration Specialist II (vAuto)

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Remote or Hybrid
United States
50000 Employees
20-30 Hourly

Cox Enterprises Logo Cox Enterprises

Outside Plant Compliance Technician I

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Hybrid
Oceanside, CA, USA
50000 Employees
32-48 Hourly

Similar Companies Hiring

Milestone Systems Thumbnail
Artificial Intelligence • Other • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account