The Role
The Senior Staff Systems Engineer will oversee the architectural design of a multi-agent platform, ensuring scalability and security while mentoring teams and driving technical strategies.
Summary Generated by Built In
At ASAPP, our mission is simple: deliver the best AI-powered customer experience—faster than anyone else. We are guided by principles that shape how we think, build, and execute, including deep customer obsession, purposeful speed, ownership, and a relentless focus on outcomes. We work in small, highly skilled teams, prioritize clarity over complexity, and continuously evolve through curiosity, data, and craftsmanship.
We’re building a globally diverse team of technologists and problem solvers who thrive in fast-paced environments, value collaboration, and approach every challenge with a Day 1 mindset. With hubs in New York City, Mountain View, Latin America, and India. If you’re driven by continuous learning, rapid iteration, and the challenge of building in a high-growth startup, this is more than a role—it’s a journey.
We are seeking a Senior Staff Systems Engineer to drive the architectural vision for our GenerativeAgent product. In this role, you will design and build a highly scalable, multi-agent platform that powers real-time voice and text customer service experiences across a wide range of industries.
As a Senior Staff Engineer, you will set long-term system direction, tackle the organization’s most complex technical challenges, and partner closely with engineering, product, security, and operations leaders. You will ensure our systems are resilient, scalable, and tightly aligned with both customer needs and business goals, while maintaining a strong hands-on presence and broad organizational impact.
What you'll do
- Act as a technical authority and advisor across multiple engineering teams
- Develop and drive alignment on system design, technical roadmaps, and best practices
- Design and implement a scalable, multi-tenant deployment architecture that supports easy configuration of agents and business workflows for various customers
- Define the communication, state management, and orchestration patterns for multi-agent systems
- Mentor senior engineers and help raise the bar on systems thinking across the organization
- Own and define system-level SLOs/SLIs for high-traffic, real-time voice and text services, focusing on latency, cost-efficiency, and fault tolerance across the ecosystem
- Identify systemic risks and proactively design mitigation strategies
- Partner with Security and Compliance teams to ensure systems meet regulatory and security requirements
- Lead post-incident analysis and drive systemic improvements
- Partner with Product, Customer Engineering, SRE, and TPMs to translate business requirements into system designs
- Work with Research to evaluate and productionize cutting-edge ideas in the ML space
- Drive complex initiatives that span multiple quarters and involve multiple teams
- Communicate complex technical concepts clearly to both technical and non-technical stakeholders
Technical Leadership & Influence
Reliability, Scalability & Security
Cross-Functional Collaboration
What you'll need
- 10+ years of experience building large-scale production systems
- Mastery in at least one cloud platform (AWS, GCP, Azure)
- Expertise with container orchestration (Kubernetes)
- Expertise with Python and/or Golang
- Excellent communication, consensus-building, strategic thinking, and mentorship abilities
- Distributed systems design patterns (e.g., service mesh, event-driven architecture, microservices)
- Reliability engineering principles
- System performance and capacity planning
- Ability to lead through influence rather than authority
Deep understanding of:
What we'd like to see
- Expertise with the LLM development lifecycle (e.g. fine-tuning, RAG, deployment, evaluation, monitoring & feedback)
- Strong track record of building multi-agent systems at scale
- Experience with security, compliance, and data privacy requirements (e.g. HIPAA, SOC 2)
ASAPP is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, disability, age, or veteran status. If you have a disability and need assistance with our employment application process, please email us at [email protected] to obtain assistance. #LI-AG1 #LI-Hybrid
Top Skills
AWS
Azure
GCP
Go
Kubernetes
Python
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Our artificial intelligence and machine learning products deliver automation and human augmentation, allowing individuals and organizations to realize their full potential. Today, the world's largest organizations rely on ASAPP to provide amazingly efficient and effective customer experiences. Our Research & Development team is unparalleled, driving the advancement of AI, machine learning, speech recognition, robotic process automation, natural language processing and more.
