Software Engineer, Data Platform

Sorry, this job was removed at 06:12 p.m. (CST) on Monday, Aug 04, 2025
2 Locations
In-Office
Information Technology • Internet of Things
We make software to build trust between businesses.
The Role

About Middesk

Middesk makes it easier for businesses to work together. Since 2018, we’ve been transforming business identity verification, replacing slow, manual processes with seamless access to complete, up-to-date data. Our platform helps companies across industries confidently verify business identities, onboard customers faster, and reduce risk at every stage of the customer lifecycle.

Middesk came out of Y Combinator, is backed by Sequoia Capital and Accel Partners, and was recently named to Forbes Fintech 50 List and cited as an industry leader in business verification by digital identity strategy firm, Liminal.

About Middesk Engineering:

"Velocity" is the rate at which we effect realized value for our customers, not the rate at which we ship code. We believe that great products result when technical excellence and craft is combined with deep understanding of our customers and the problems we can help them solve. We’re a humble, self-motivated team that seeks to ship early and ship often; we pride ourselves with being willing to roll up our sleeves to solve even the messiest problems our customers present to us.  Middesk Engineering is customer-first engineering.

 The Role:

Middesk is, at its core, a data company. We live and die by the quality of our data asset and the engine that powers it. We’re on a mission to build a comprehensive and complete business dataset for every business in the world. As part of the Foundation team at Middesk, you’ll collaborate with Data Science, Infrastructure and Data Engineering to build and maintain our own proprietary Entity Resolution system used to power the Middesk business identity platform, scaling our system to resolve millions of business identities across hundreds of data sources and thousands of distinct data sets. You’ll often work with and support product engineers looking to launch new products and features.

The ideal candidate is ready to learn relentlessly, eager to learn a wide-breadth of technologies and software stacks,  build and scale our data infrastructure and data pipelines and connect them into our core business verification products. 

We follow a hybrid work model, and for this role, there is an expectation of 2 days per week in our SF or NYC office. Candidates should be based within a commutable distance, as we believe in the value of in-person collaboration and building strong team connections while also supporting flexibility where possible.

What You'll Do:  
  • Build the batch and streaming data pipelines critical to Middesk’s data infrastructure using Airflow, BigQuery, Dataflow, Dataproc and VertexAI.

  • Build reliable, scalable, maintainable, and cost-efficient systems across the stack.

  • Build, scale and extend existing web scraping platforms and capabilities used for real-time data acquisition.

  • Build, update and maintain our interface layer between our application and data platform stack to improve performance and as we continue to scale our platform and datasets. 

What We’re Looking For:
  • 5+ years of experience working in a data engineering or backend engineering role

  • Strong programming skills in at least one backend language and web application framework

  • Knowledge of SQL and experience with RDMS like postgresql, mySQL, etc.

Nice to Haves:
  • Fluency with Ruby, Python or Go

  • Experience building and designing collections stored on ElasticSearch 

  • Experience working with Airflow or other orchestration platforms 

  • Experience working on data pipelines and data streaming with tools like Spark or Kafka

  • Experience building machine learning systems

  • Experience with Terraform, Datadog, or Kubernetes

  • Experience with scraper technologies, including agentic AI

Similar Jobs

Flume Health Logo Flume Health

Software Engineer

Healthtech • Insurance • Software
In-Office or Remote
New York, NY, USA
22 Employees
140K-180K Annually

Gusto Logo Gusto

Senior Software Engineer

Fintech • HR Tech
Easy Apply
Hybrid
6 Locations
4405 Employees
163K-247K Annually
In-Office
3 Locations
72000 Employees
184K-276K Annually
In-Office
3 Locations
72000 Employees
158K-237K Annually
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
New York, New York
130 Employees
Year Founded: 2019

What We Do

Middesk makes it easier for businesses to work together. Since 2018, we’ve been transforming business identity verification, replacing slow, manual processes with seamless access to complete, up-to-date data. Our platform helps companies across industries confidently verify business identities, onboard customers faster, and reduce risk at every stage of the customer lifecycle.

Middesk came out of Y Combinator, is backed by Sequoia Capital and Accel Partners, and was recently named to Forbes Fintech 50 List and cited as an industry leader in business verification by digital identity strategy firm, Liminal.

Why Work With Us

We value curiosity, empathy, and diverse perspectives. We're excited about the scope of the problems we're working to solve. We look at situations based on first principles and prefer learning by doing. We have diverse backgrounds and skills, but we're passionate about our craft, hobbies, and the relationships we build.

Gallery

Gallery

Similar Companies Hiring

Rain Thumbnail
Web3 • Payments • Infrastructure as a Service (IaaS) • Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
70 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account