Data Engineer

Posted 20 Days Ago
Hiring Remotely in USA
Remote
180K-220K Annually
Senior level
Software • Database
The Role
Build scalable data ingestion, transformation, and loading infrastructure using Spark, SQL, AWS, and Databricks. Develop entity resolution systems, CI/CD pipelines, anomaly detection, and data quality processes. Design scalable processing systems, orchestration workflows, storage patterns, and data warehouse solutions. Collaborate remotely, document technical designs, scope projects, and solve complex data engineering and data science problems.
Summary Generated by Built In

Note for all engineering roles: with the rise of fake applicants and AI-enabled candidate fraud, we have built in additional measures throughout the process to identify such candidates and remove them.

About Us

People Data Labs (PDL) is the provider of people and company data. We do the heavy lifting of data collection and standardization so our customers can focus on building and scaling innovative, compliant data solutions. Our sole focus is on building the best data available by integrating thousands of compliantly sourced datasets into a single, developer-friendly source of truth. Leading companies across the world use PDL’s workforce data to enrich recruiting platforms, power AI models, create custom audiences, and more.

We are looking for individuals who can balance extreme ownership with a “one-team, one-dream” mindset. Our customers are trying to solve complex problems, and we only help them achieve their goals as a team. Our Data Engineering Team is the secret sauce behind all that we do and we are looking for the best of the best.

If you are looking to be part of a team discovering the next frontier of data-as-a-service (DaaS) with a high level of autonomy and opportunity for direct contributions, this might be the role for you. We like our engineers to be thoughtful, quirky, and willing to fearlessly try new things. Failure is embraced at PDL as long as we continue to learn and grow from it.

What You Get to Do

  • Build infrastructure for ingestion, transformation, and loading an exponentially increasing volume of data from a variety of sources using Spark, SQL, AWS, and Databricks

  • Building an organic entity resolution framework capable of correctly merging hundreds of billions of individual entities into a number of clean, consumable datasets.

  • Developing CI/CD pipelines and anomaly detection systems capable of continuously improving the quality of data we're pushing into production.

  • Dreaming up solutions to largely undefined data engineering and data science problems.

The Technical Chops You’ll Need

  • 3-5+ years of industry experience with clear examples of strategic technical problem-solving and implementation

  • Strong software development fundamentals.

  • Experience with Python 

  • Expertise with Apache Spark (Java, Scala, and/or Python-based)

  • Experience with SQL

  • Experience building scalable data processing systems (e.g., cleaning, transformation)  from the ground up.

  • Experience using developer-oriented data pipeline and workflow orchestration (e.g., Airflow (preferred), dbt, dagster or similar)

  • Knowledge of modern data design and storage patterns (e.g., incremental updating, partitioning and segmentation, rebuilds and backfills)

  • Experience working in Databricks (including delta live tables, data lakehouse patterns, etc.)

  • Experience with cloud computing services (AWS (preferred), GCP, Azure or similar)

  • Experience with data warehousing (e.g., Databricks, Snowflake, Redshift, BigQuery, or similar)

  • Understanding of modern data storage formats and tools (e.g., parquet, ORC, Avro, Delta Lake)

People Thrive Here Who Can

  • Balance high ownership and autonomy with a strong ability to collaborate

  • Work effectively remotely (able to be proactive about managing blockers, proactive on reaching out and asking questions, and participating in team activities)

  • Demonstrate strong written communication skills on Slack/Chat and in documents

  • Exhibt experience in writing data design docs (pipeline design, dataflow, schema design)

  • Scope and breakdown projects, communicate and collaborate progress and blockers effectively with your manager, team, and stakeholders

Some Nice To Haves

  • Degree in a quantitative discipline such as computer science, mathematics, statistics, or engineering

  • Experience working with entity data (entity resolution / record linkage)

  • Experience working with data acquisition / data integration

  • Expertise with Python and the Python data stack (e.g., numpy, pandas)

  • Experience with streaming platforms (e.g., Kafka)

  • Experience evaluating data quality and maintaining consistently high data standards across new feature releases (e.g., consistency, accuracy, validity, completeness)

Comp: $180K - $200K

Our Benefits

  • Stock

  • 401k

  • Competitive Salaries

  • Unlimited paid time off

  • Medical, dental, & vision insurance 

  • Health, fitness, and office stipends

  • The permanent ability to work wherever and however you want

Why People Data Labs?

Great People make great teams. It is as simple and elegant as that. We believe in building highly functional, energetic, and engaging teams to serve our customers. People, Customers, Shareholders, in that order, sets us up for success and delivering on our promises.

If all of that sounds good to you, we can’t wait to hear from you and build something amazing together!

Check out our latest company kickoff video to get a taste of our company culture:

People Data Labs does not discriminate on the basis of race, sex, color, religion, age, national origin, marital status, disability, veteran status, genetic information, sexual orientation, gender identity or any other reason prohibited by law in provision of employment opportunities and benefits.

Qualified Applicants with arrest or conviction records will be considered for Employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

Personal Privacy Policy for California Residents

https://privacy.peopledatalabs.com/policies?name=applicant-privacy-policy

Skills Required

  • 3-5+ years of industry experience with strategic technical problem-solving and implementation
  • Strong software development fundamentals
  • Experience with Python
  • Expertise with Apache Spark using Java, Scala, and/or Python
  • Experience with SQL
  • Experience building scalable data processing systems from the ground up
  • Experience with data pipeline and workflow orchestration tools such as Airflow, dbt, or Dagster
  • Knowledge of modern data design and storage patterns, including incremental updates, partitioning, segmentation, rebuilds, and backfills
  • Experience working in Databricks, including Delta Live Tables and data lakehouse patterns
  • Experience with cloud computing services such as AWS, GCP, or Azure
  • Experience with data warehousing technologies such as Databricks, Snowflake, Redshift, or BigQuery
  • Understanding of modern data storage formats and tools such as Parquet, ORC, Avro, or Delta Lake
  • Ability to balance ownership and autonomy with collaboration
  • Ability to work effectively remotely and proactively manage blockers
  • Strong written communication skills
  • Experience writing data design documents
  • Ability to scope and break down projects and communicate progress and blockers
  • Degree in a quantitative discipline such as computer science, mathematics, statistics, or engineering
  • Experience with entity data, entity resolution, or record linkage
  • Experience with data acquisition or data integration
  • Expertise with Python data-stack tools such as NumPy and pandas
  • Experience with streaming platforms such as Kafka
  • Experience evaluating data quality and maintaining high data standards
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
130 Employees
Year Founded: 2015

What We Do

At People Data Labs, we know that every company is rapidly transforming to solve problems in a more data and people-driven manner. In order to succeed, companies are forming data departments, pivoting their focus into data acquisition, and doubling down on legal, security, and compliance to protect themselves. For these organizations, clean, rich, and compliant person data is critical and People Data Labs is here to meet that demand. Today, the People Data Labs platform seeks to enable all companies to build compliant people data solutions. Our sole focus is on building the best data available by integrating thousands of compliantly-sourced datasets into a single, developer-friendly source of truth. Over 2 billion profiles are used by leading companies to enrich recruiting platforms, power AI models, create custom audiences, and more.

Similar Jobs

Rain Logo Rain

Data Engineer

Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
Remote or Hybrid
30 Locations
100 Employees
128K-167K Annually

Capital One Logo Capital One

Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Remote or Hybrid
McLean, VA, USA
55000 Employees
179K-225K Annually

Circle Logo Circle

Data Engineer

Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
In-Office or Remote
San Francisco, CA, USA
1050 Employees
123K-165K Annually

Optum Logo Optum

Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Eden Prairie, MN, USA
160000 Employees
113K-193K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account