Senior Software Engineer, Data Platform

Reposted 9 Days Ago
Be an Early Applicant
San Francisco, CA, USA
Hybrid
230K-265K Annually
Senior level
Fintech • Payments • Software • Financial Services
The Role
Lead design, build, and maintenance of scalable data pipelines and lakehouse infrastructure using PySpark, Databricks, and Airflow. Own data & ML platform (Terraform, Databricks), improve observability, data quality, and developer tooling, and partner closely with Data Science and engineering teams.
Summary Generated by Built In

About Us:

At Parafin, we’re on a mission to grow small businesses.
Small businesses are the backbone of our economy, but traditional banks often don’t have their backs. We build tech that makes it simple for small businesses to access the financial tools they need through the platforms they already sell on.
We partner with companies like DoorDash, Amazon, Worldpay, and Mindbody to offer fast and flexible funding, spend management, and savings tools to their small business users via a simple integration. Parafin takes on all the complexity of capital markets, underwriting, servicing, compliance, and customer service for our partners.
We’re a tight-knit team of innovators hailing from Stripe, Square, Plaid, Coinbase, Robinhood, CERN, and more — all united by a passion for building tools that help small businesses succeed. Parafin is backed by prominent venture capitalists including GIC, Notable Capital, Redpoint Ventures, Ribbit Capital, and Thrive Capital. Parafin is a Series C company, and we have raised more than $194M in equity and $340M in debt facilities.
Join us in creating a future where every small business has the financial tools they need.

About the Position:

We’re looking for a seasoned software engineer to join Parafin’s Infrastructure team and lead the development of our next-generation Data Platform. This role is critical to ensuring that our data infrastructure is reliable, scalable, and developer-friendly as we continue to power financial services for small businesses.

As a Senior Software Engineer, you’ll be responsible for designing, building, and maintaining the systems that ingest, transform, and serve data across the company. You’ll partner closely with Data Science, Platform Engineering, and Product Engineering teams to support data-driven product development and decision-making.

What You’ll Do:
  • Design and build robust, highly scalable data pipelines and lakehouse infrastructure with PySpark, Databricks, and Airflow on AWS.

  • Improve the data platform development experience for Engineering, Data Science, and Product by creating intuitive abstractions, self‑service tooling, and clear documentation.

  • Own and maintain core data pipelines and models that power internal dashboards, ML models, and customer-facing products.

  • Own the Data & ML platform infrastructure using Terraform, including end‑to‑end administration of Databricks workspaces: manage user access, monitor performance, optimize configurations (e.g., clusters, lakehouse settings), and ensure high availability of data pipelines.

  • Lead projects to improve data quality, testing, observability, and cost efficiency across existing pipelines and backend systems (e.g., migrating Databricks SQL pipelines to dbt, scaling data ingestion, improving data-lineage tracking, and enhancing monitoring).

  • Act as the primary engineering partner for the Data Science team—embedded closely to gather requirements, design scalable solutions, and provide end-to-end support on all engineering aspects of their work.

  • Work closely with backend engineers and data scientists to design performant data models and support new product development initiatives.

  • Share best practices and mentor other engineers working on data-centric systems.

What We’re Looking For:
  • 4+ years of experience in software engineering with a strong background in data infrastructure, pipelines, and distributed systems.

  • Advanced proficiency in Python and SQL.

  • Hands-on Spark development experience.

  • Expertise with modern cloud data stacks—AWS (S3, RDS), Databricks, and Airflow—and lakehouse architectures.

  • Hands‑on experience with foundational data‑infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms), Delta Lake/Iceberg, and distributed query engines like Trino/Presto.

  • Familiarity with ingestion frameworks, developer‑experience tooling, and best practices for data versioning, lineage, partitioning, and clustering.

  • Strong problem-solving skills and a proactive attitude toward ownership and platform health.

  • Excellent communication and collaboration skills, especially in cross-functional settings.


Bonus Points
  • Experience with AWS infrastructure using Terraform.

  • Familiarity with observability tools (e.g., Datadog) and cost tracking in cloud environments.

  • Experience with financial systems or building platforms in a fintech setting.

  • Prior work on ML infrastructure: Feature stores (e.g., Tecton), ML model lifecycle (training, deployment, monitoring, retraining), real-time inference.

  • Contributions to internal tooling or open-source projects in the data ecosystem.

What We Offer:
  • Salary Range: $230k-$265k

  • Equity grant

  • Medical, dental & vision insurance

  • Work from home flexibility

  • Unlimited PTO

  • Commuter benefits

  • Free lunches

  • Paid parental leave

  • 401(k)

  • Employee assistance program

If you require reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please contact us.

Top Skills

Airflow
Apache Iceberg
Aws Rds
Aws S3
Databricks
Datadog
Dbt
Delta Lake
Feature Store
Hadoop
Hive
Kafka
Presto
Pyspark
Python
Spark
SQL
Tecton
Terraform
Trino
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
99 Employees
Year Founded: 2020

What We Do

Parafin’s infrastructure powers financial services for marketplaces, vertical SaaS, payment platforms, and more. With a single integration, platforms can launch a full suite of financial products for their small business sellers, including capital, spend management, and savings tools. These services provide access to financing and help businesses thrive by leveraging real-time performance data to offer customized financial solutions.

Similar Jobs

Chime Logo Chime

Senior Software Engineer

Fintech • Machine Learning • Mobile • Security • Software
Easy Apply
Hybrid
San Francisco, CA, USA
1500 Employees
164K-227K Annually

Genius Sports Logo Genius Sports

Senior Software Engineer

AdTech • Artificial Intelligence • Machine Learning • Marketing Tech • Software • Sports • Big Data Analytics
Easy Apply
Hybrid
Los Angeles, CA, USA
1800 Employees
180K-220K Annually

Chime Logo Chime

Senior Software Engineer

Fintech • Machine Learning • Mobile • Security • Software
Easy Apply
Hybrid
San Francisco, CA, USA
1500 Employees
187K-259K Annually

NVIDIA Logo NVIDIA

Senior Software Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office
Santa Clara, CA, USA
21960 Employees
168K-322K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account