Senior Software Engineer, Data Platform

Posted Yesterday
Be an Early Applicant
San Francisco, CA, USA
Hybrid
190K-250K Hourly
Senior level
Information Technology • Other • Security • Social Impact • Software • Cybersecurity • Data Privacy
Persona helps companies of all sizes verify individuals and businesses and automate any identity-related use case.
The Role
Design, build, and operate Persona's large-scale data platform: datalake and lakehouse, streaming and batch ingestion (including CDC), high-throughput data-movement services, real-time serving layer, and query/analytics capabilities. Drive architecture decisions, performance, reliability, and cost, and lead multi-quarter infrastructure projects while mentoring engineers and partnering with infrastructure, data science, and product teams.
Summary Generated by Built In

About Persona

Persona is the configurable identity platform built for businesses in a digital-first world. Verifying individuals and organizations is harder — but more important — than ever, with AI enabling fraudsters to launch sophisticated accounts at scale and regulations evolving rapidly.

We’ve built Persona to support practically every use case and industry — that’s why we’re able to serve a wide range of leading companies. For example, Reddit relies on Persona for age assurance and verification to comply with online safety regulations, protecting younger users while maintaining a seamless experience. Meanwhile, OpenAI relies on Persona to keep bad actors out, protecting one of the world’s most powerful AI platforms from large-scale abuse in a time when AI is reshaping the way we work and live.

We’re growing rapidly and looking for exceptional people to join us!

About the role

We are looking for passionate engineers who are excited to build the data foundation for the identity layer of the internet. As a senior engineer on the Data Platform team at Persona, you'll design, build, and operate the systems that move and store data at massive scale — an Iceberg datalake, the streaming and batch pipelines that feed it, a multi-provider warehouse layer, and the services built on top of it. You'll work the full depth of that stack, from raw ingestion through storage layout and compute all the way to the query layer — owning the performance, reliability, and cost of each. You'll set technical direction for major pieces of this platform — making the architecture, storage-format, and build-vs-buy decisions that shape it for years — and raise the bar for the engineers around you. This is a high-ownership role on a small team, working closely with the rest of engineering, data science, and infrastructure to make the platform fast, reliable, and cost-efficient at hundreds of billions of records per day.

What you'll do at Persona
  • Build and scale our datalake — the pipelines that feed it and the storage design that keeps it fast and efficient.

  • Develop high-throughput data-movement and ingestion services that bring data into the platform reliably and at scale.

  • Own streaming and batch ingestion and the change-data-capture pipelines that absorb billions of records and terabytes of data per day.

  • Build new query and analytics capabilities directly on the datalake — for use cases that don't fit a traditional warehouse.

  • Operate the low-latency serving layer for real-time, high-concurrency access to platform data.

  • Partner with infrastructure and product teams to provision, secure, and scale the platform.

What you'll bring to Persona
  • 5+ years of experience in software engineering, with deep expertise in data infrastructure or large-scale distributed systems.

  • Proficiency in Python — our primary language across pipelines. Our newest services are written in Go, so you either work in Go today or are excited to ramp into it.

  • Hands-on experience with big-data or streaming technologies such as Spark, Kafka, or Flink, and interest in lakehouse table formats like Iceberg.

  • Experience building and operating scalable data pipelines across structured and unstructured data.

  • A track record of leading complex, multi-quarter infrastructure projects end to end and driving architecture decisions across teams.

  • Experience mentoring engineers and operating effectively in ambiguity — defining the problem, not just the solution.

  • Strong fundamentals in distributed systems, storage, and performance/cost optimization.

  • Excellent communication and collaboration skills across engineering, data science, and infrastructure teams.

  • Nice to have: ClickHouse, DuckDB, Google Cloud (GCP), Kubernetes, MySQL, MongoDB, Snowflake.

Benefits and Perks

For full-time US-based employees (excluding internship and contractor opportunities), Persona offers a wide range of benefits, including medical, dental, and vision, 3% 401(k) contribution, unlimited PTO, quarterly mental health days, family planning benefits, professional development stipend, wellness benefits, among others.


For full-time UK employees, Persona offers a wide range of benefits, including private medical insurance, dental insurance, a 6% employer pension contribution, unlimited PTO, a monthly wellness stipend, professional development stipend, co-working stipend, and more.


As part of our interview process, all candidates will be asked to verify their identity with Persona. This step is used solely to confirm that candidates are who they say they are, and will have no impact on hiring decisions.

Skills Required

  • 5+ years of experience in software engineering with deep expertise in data infrastructure or large-scale distributed systems.
  • Proficiency in Python.
  • Experience with or willingness to ramp into Go.
  • Hands-on experience with big-data or streaming technologies such as Spark, Kafka, or Flink.
  • Experience building and operating scalable data pipelines across structured and unstructured data.
  • Experience owning streaming and batch ingestion and change-data-capture pipelines at high scale.
  • Track record of leading complex, multi-quarter infrastructure projects end-to-end and driving architecture decisions.
  • Experience mentoring engineers and operating effectively in ambiguity.
  • Strong fundamentals in distributed systems, storage, and performance/cost optimization.
  • Excellent communication and collaboration skills across engineering, data science, and infrastructure teams.
  • Interest in lakehouse table formats like Iceberg.
  • Nice-to-have: ClickHouse, DuckDB, Google Cloud (GCP), Kubernetes, MySQL, MongoDB, Snowflake.

Persona Identities Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Persona Identities and has not been reviewed or approved by Persona Identities.

  • Fair & Transparent Compensation Engineering pay is portrayed as market-competitive, and role-specific salary pages display a visible range of titles and pay across functions. Recent compensation submissions indicate strong packages in core roles, supporting market alignment.
  • Retirement Support A non‑elective company 401(k) contribution is provided, adding reliable retirement value regardless of employee deferrals. This element is consistently highlighted across public benefits descriptions.
  • Parental & Family Support Paid parental leave of substantial length and support for adoption and surrogacy are explicitly offered, with flexibility to take leave over an extended window. Family‑planning resources further bolster coverage for different paths to parenthood.

Persona Identities Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
600 Employees
Year Founded: 2018

What We Do

Persona helps businesses manage KYC/AML/KYB programs, fight fraud, and build trust by automating any identity-related use case with our flexible identity infrastructure. For example, we help Branch automate their KYC process and Coursera verify learners’ identities before delivering course credentials. Beyond securely collecting and verifying user information such as PII, government IDs, and biometric selfies, our platform also provides flexible case review and orchestration tools to help businesses streamline and automate their identity operations — from setting custom rules to ingesting third-party data and triggering external actions.

Why Work With Us

Persona's a leader in identity verification, offering unmatched flexibility to meet diverse business needs. With customizable building blocks, our product adapts to various industries, use cases, and risk levels. Our core value of having a People-first culture thrives on new perspectives that enrich the workplace and support our mission and value.

Gallery

Gallery

Similar Jobs

Airwallex Logo Airwallex

Senior Software Engineer

Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Hybrid
San Francisco, CA, USA
2200 Employees
158K-260K Annually

Samsara Logo Samsara

Senior Software Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
131K-220K Annually

NVIDIA Logo NVIDIA

Software Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office
3 Locations
21960 Employees
152K-288K Annually
In-Office
San Francisco, CA, USA
800 Employees
192K-240K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account