Staff Software Engineer, Foundations

Posted Yesterday
Hiring Remotely in U.S.
Remote
260K-306K Annually
Expert/Leader
Software
The Role
Lead the migration of Vanta’s resource data platform from MongoDB to schema-aware PostgreSQL while maintaining API compatibility and data integrity. Design high-throughput Kafka and S3 ingestion pipelines, eventual-consistency strategies, query infrastructure, tenant isolation, and reliable distributed systems. Set architectural direction across storage, caching, and streaming technologies; mentor engineers; drive cross-team technical roadmaps; and improve reliability, observability, and operational excellence.
Summary Generated by Built In

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. 

As a Staff Software Engineer on the Automation - Foundations team, you will lead the re-platforming of the data layer underneath Vanta’s entire compliance product. This is a migration that spans multiple teams, has to preserve every public API contract along the way, and cannot lose a single customer’s evidence while it happens.

Foundations is Vanta’s data platform team. We ingest security and compliance data from across our customer’s environments, currently tens of thousands of resources per second, with single-customer bursts running into the millions. We store the data, catalog it, make it queryable, and turn it into evidence that has to survive a real SOC 2 or FedRAMP audit.

We are in the middle of moving our platform from a Mongo-centric architecture to a schema-aware, Postgres-backed architecture, on a Kafka and S3 pipeline that decouples data fetching from processing. Both pipelines run in parallel today, the hard problems here are correctness under migration, eventual consistency, and multi-tenancy, in a domain where “mostly right” is not an acceptable failure mode.

Visit our Vanta Engineering Blog to learn more about what our team is working on.

What you'll do as a Staff Software Engineer at Vanta:

  • Lead the migration of Vanta’s resource data model from a Mongo-centric solution to a schema-aware Postgres-backed solution and running both generations in parallel without breaking a customer integration.

  • Drive solutions across teams that you do not own but are dependent on the platform built by your team.

  • Design for correctness under eventual consistency with idempotent session handling, conditional writes that survive out-of-order delivery, reconciliation rather than strict cross-service validation, and explicitly backpressure instead of implicit database limits.

  • Design and evolve Vanta's data ingestion and pipeline architecture, ensuring reliable, high-throughput processing of terabyte-scale data streams across distributed systems

  • Take our Query API from internal use to a production platform with schema versioning, joins and exports, per-tenant isolation, and predictable latency under load.

  • Build data infrastructure where correctness is externally auditable as the evidence Vanta produces has to hold up in front of an auditor.

  • Diagnose the failures that only appear at production data shapes and can include hot partitions, unbounded fan-out, and online rewrites of continuously-written tables.

  • Set architectural direction for streaming infrastructure (Kafka and event queuing), caching layers (Redis), and persistent storage (Postgres, MongoDB) across the Foundations stack

  • Mentor senior engineers across the team, raising the technical bar through design reviews, architectural guidance, and hands-on contributions to the most complex systems challenges

  • Champion engineering excellence in reliability, observability, and operational hygiene across the data infrastructure that powers Vanta's core product

  • Leverage AI tools and systems to accelerate your own work and explore how they can improve the systems you build

How to be successful in this role:

  • Proven track record leading platform migration initiatives (v1→v2 architecture transitions) while maintaining backward compatibility and system availability

  • Strong command of streaming and queuing infrastructure (Kafka or equivalent), including partitioning strategy, consumer group semantics, redelivery, and idempotency.

  • Deep industry experience in distributed systems and data pipeline engineering, with demonstrated experience designing and operating systems at enterprise scale (terabyte-scale ingestion, high-throughput event processing)

  • Fluency in both relational and document data modeling at scale (Postgres and MongoDB), including query planning, connection pooling, and online schema change on large, continuously written tables.

  • Experience collaborating with engineering leadership to define multi-quarter technical roadmaps and drive them through to delivery

  • Solid AWS fundamentals and comfort operating in TypeScript and Node.

  • Able to articulate complex systems tradeoffs to both technical and non-technical audiences and bring cross-functional partners along on long-horizon technical decisions

  • Open to using AI to amplify your skills and strengthen your work - demonstrating curiosity, a willingness to learn, and sound judgment in applying AI responsibly to improve efficiency and impact.


What you can expect as a Vanta’n:

  • Industry-competitive salary and equity

  • Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans

  • 16 weeks of paid Parental Leave for all new parents

  • Health & wellness stipend

  • Remote workspace, internet, and cellphone stipend

  • Commuter benefits for team members who report to the SF and NYC offices

  • Family planning benefits

  • Matching 401(k) contribution with immediate vesting

  • Flexible PTO policy, plus 80 hours of Sick Time

  • 11 company-paid holidays

  • Virtual team-building activities, lunch-and-learns, and other company-wide events!

  • Offices in SF, NYC, London, Dublin, Tel Aviv, and Sydney

#LI-remote

At Vanta, we are committed to hiring diverse talent of different backgrounds and as such, it is important to us to provide an inclusive work environment for all. We do not discriminate on the basis of race, gender identity, age, religion, sexual orientation, veteran or disability status, or any other protected class. As an equal opportunity employer, we encourage and welcome people of all backgrounds to apply.

About Vanta

We started in 2018, in the wake of several high-profile data breaches. Online security was only becoming more important, but we knew firsthand how hard it could be for fast-growing companies to invest the time and manpower it takes to build a solid security foundation. Vanta was inspired by a vision to restore trust in internet businesses by enabling companies to improve and prove their security. From our early days automating security monitoring for compliance standards like SOC 2, HIPAA and ISO 27001 to creating the world's leading Trust Management Platform, our vision remains unchanged. 

Now more than ever, making security continuous—not just a point-in-time check— is essential. Thousands of companies rely on Vanta to build, maintain and demonstrate their trust— all in a way that's real-time and transparent.

Referral Instructions

If you are being referred for the role, please contact that person to apply on your behalf.

 
 
 

Skills Required

  • Proven experience leading platform migration initiatives between major architecture versions while maintaining backward compatibility and availability
  • Strong command of Kafka or equivalent streaming and queuing infrastructure, including partitioning, consumer groups, redelivery, and idempotency
  • Deep industry experience in distributed systems and data pipeline engineering at enterprise scale
  • Experience designing and operating terabyte-scale ingestion and high-throughput event-processing systems
  • Fluency in relational and document data modeling at scale using PostgreSQL and MongoDB
  • Experience with query planning, connection pooling, and online schema changes on continuously written tables
  • Experience defining multi-quarter technical roadmaps with engineering leadership and driving delivery
  • Solid AWS fundamentals and proficiency with TypeScript and Node.js
  • Ability to communicate complex systems tradeoffs to technical and non-technical audiences and align cross-functional partners
  • Curiosity and sound judgment in applying AI tools responsibly to improve efficiency and impact

Vanta Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Vanta and has not been reviewed or approved by Vanta.

  • Healthcare Strength Health coverage is described as comprehensive, with employer-covered premiums for many employee-only plan options alongside dental, vision, and mental-health support. Plan designs are portrayed as robust with low-to-no premium options available on some offerings.
  • Parental & Family Support Paid parental leave for all parents is highlighted as fully paid and substantial in length. Family-related support is consistently presented as a core part of the package.
  • Flexible Benefits Remote-first flexibility and multiple stipends (wellness, phone/internet, home office, and commuter in hub locations) are emphasized as standard components. Flexible schedules further support differing employee needs across locations.

Vanta Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
361 Employees
Year Founded: 2016

What We Do

Our mission at Vanta is to be a layer of trust on top of cloud services, to secure the internet, increase trust in software companies, and keep consumer data safe. Think of us as your automated security and compliance expert.

Similar Jobs

Remote
USA
505 Employees
173K-264K Annually

Granica Logo Granica

Software Engineer

Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
In-Office or Remote
Mountain View, California, USA
45 Employees

Civic Roundtable Logo Civic Roundtable

Senior Product Manager

Social Impact • Software
In-Office or Remote
Boston, MA, USA
30 Employees
140K-170K Annually

SailPoint Logo SailPoint

Customer Success Manager

Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
United States
2461 Employees
60K-101K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account