Senior Data Engineer

Posted 4 Days Ago
Hiring Remotely in Pasadena, CA, USA
In-Office or Remote
Senior level
Big Data • Consumer Web • eCommerce • Enterprise Web • Software • Analytics • Big Data Analytics
Join our mission to make the world more transparent with data.
The Role
Develop and optimize large-scale data systems, ETL pipelines, storage, entity-resolution products, and data automation infrastructure. Build and integrate ingestion and processing pipelines using AWS, Airflow, Spark, PySpark, and EMR. Create testing and monitoring components, develop analytical tools, support data governance and quality, collaborate with data science teams, and document technical solutions.
Summary Generated by Built In

About Spokeo:

Join our mission to make the world more transparent with data.

Spokeo is a people intelligence platform that helps over 18 million monthly visitors reconnect with friends, reunite with families, and build trust in new relationships. Thousands of companies also trust Spokeo’s 60 billion public records to improve customer research, help verify information, and prevent fraud.

Founded in 2006, Spokeo has built a dedicated, remote-first team with an average tenure of 6.9 years. It has earned recognition from Comparably as a Best Company for Compensation, Employee Happiness, Perks and Benefits, Support for Women, Work-Life Balance, and CEO Leadership.

About this Opportunity

As a Senior Data Engineer at Spokeo, you will develop, optimize, and improve our data systems, including ETL pipelines, storage, and entity resolution. This involves working with infrastructure built in AWS, including Airflow, PySpark, EMR, S3, DynamoDB, and more. This role will help build and improve data products, automation platform features, analytical software packages, and data pipeline orchestration tools.

What You’ll Do:

  • Build infrastructure and data automation pipelines to ingest, process, and load data from various sources. Automate and integrate new components into the data pipeline.

  • Collaborate with stakeholders and data science teams to develop data products, including entity resolution and best selection, to efficiently execute product vision and strategy in alignment with organizational goals and priorities.

  • Create unit and stress-test components to monitor technical performance and ensure that identified issues are resolved.

  • Develop data analysis tools to provide data insights and capture key metrics.

  • Research solutions and maintain technical documentation.

  • Follow best practices for data governance, quality, cleansing, and other ETL-related activities.

Who You Are:

  • Required: 7+ years of development experience in data engineering within a production environment (internships and academic settings excluded).

  • Proven experience working with large datasets exceeding 100M+ records or multiple terabytes.

  • Required: 5+ years of development experience in highly scalable, distributed systems and cluster architectures using AWS and utilizing EMR.

  • Required: 5+ years of hands-on programming experience with Python.

  • Required: 5+ years of professional experience working in big data ecosystems; Spark is required; PySpark is preferable.

  • Required: 5+ years of experience with SQL, schema design, and dimensional data modeling.

  • Required: 5+ years of professional experience working with dataflow orchestration tools, such as Airflow.

  • Required: 2+ years of experience with non-relational databases (e.g., DynamoDB, Elasticsearch, etc.).

  • Required: A bachelor’s degree in Computer Science, Information Systems, Mathematics, or a related field is required.

 Working at Spokeo

Spokeo offers a bonus program, equity plans, and a 401 (k). Once a year, we do a discretionary, merit-based salary increase. Additional benefits include 100% medical/dental/vision coverage and unlimited employee PTO.

Hiring at Spokeo

We extend written offers to candidates who successfully complete their selection process. Offers will depend on several factors, including, but not limited to, marketplace competition, job leveling, experience, and skills.

Privacy Notice for Candidates: https://www.spokeo.com/recruiting-policy

Spokeo is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. Spokeo fosters a business culture where ideas and decisions from all people help us grow, innovate, create the best products, and be relevant in a rapidly changing world.

Recruiters or staffing agencies: Spokeo is not obligated to compensate any external recruiter or search firm who presents a candidate or their resume or profile to a Spokeo employee without 1) a current, fully executed agreement on file, and 2) being assigned to the open position (as a search) via our applicant tracking solution.

Use of Artificial Intelligence in Our Hiring Process

Spokeo may use artificial intelligence-enabled tools to support portions of the recruiting process. These tools may help our recruiting team organize, review, and summarize application materials, candidate experience, and interview information. They may also identify potential inconsistencies or verification signals in application materials for further human review.

AI-enabled tools assist our recruiting team but do not replace human judgment. Employment decisions are made by people based on a candidate’s qualifications and the role's requirements.

#LI-Remote

Skills Required

  • 7+ years of production data engineering development experience, excluding internships and academic settings
  • Experience working with datasets exceeding 100 million records or multiple terabytes
  • 5+ years developing highly scalable distributed systems and cluster architectures using AWS and EMR
  • 5+ years of hands-on programming experience with Python
  • 5+ years of professional experience with big data ecosystems
  • Professional experience with Apache Spark; PySpark preferred
  • 5+ years of experience with SQL, schema design, and dimensional data modeling
  • 5+ years of professional experience with dataflow orchestration tools such as Airflow
  • 2+ years of experience with non-relational databases such as DynamoDB or Elasticsearch
  • Bachelor's degree in Computer Science, Information Systems, Mathematics, or a related field

Spokeo Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Spokeo and has not been reviewed or approved by Spokeo.

  • Healthcare Strength — Healthcare coverage is positioned as a standout, with medical, dental, and vision described as fully employer-paid for employees. This materially increases the overall value of the total rewards package beyond base salary.
  • Leave & Time Off Breadth — Time-off benefits are framed as expansive through an advertised unlimited PTO policy plus paid holidays. The practical value is portrayed as potentially high, especially when paired with a remote-friendly setup.
  • Retirement Support — Retirement support is included via a 401(k) with matching referenced as part of the package for eligible roles. This adds longer-term value, although the exact match formula and eligibility are presented as details to confirm.

Spokeo Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Pasadena, CA
160 Employees
Year Founded: 2006

What We Do

Spokeo is a people search engine that helps over 18 million monthly visitors reconnect with friends, reunite with families, and protect against fraud. Additionally, our 12 billion records and over 250 million unique profiles help business professionals locate people and assets, research criminal investigation subjects, and more. Founded in 2006, we have grown to a remote-first company of nearly 200 dedicated employees with an average tenure of 4.5 years. Find out why we were named a “Best Company” for 2023 by Comparably for Women, Compensation, Happiest Employees, Company Perks & Benefits, and Work-Life Balance, as well as “Best CEO” for co-founder Harrison Tang.

Why Work With Us

Our mission is to advance transparency, and to achieve that goal, we rally around six core values: listening with empathy, understanding the why, clarifying with data, innovating to learn, collaborating to achieve, and insisting on quality.

Gallery

Gallery

Similar Jobs

Block Logo Block

Senior Data Engineer

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
168K-297K Annually

Cash App Logo Cash App

Senior Data Engineer

Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
3500 Employees
168K-297K Annually

SailPoint Logo SailPoint

Senior Data Engineer

Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
United States
2461 Employees
109K-183K Annually

Eve Logo Eve

Senior Data Engineer

Legal Tech • Software • Generative AI
Easy Apply
Remote or Hybrid
United States
180 Employees
185K-210K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account