Senior Software Engineer, Big Data, Tech Enablement

Posted 4 Hours Ago
Be an Early Applicant
Hiring Remotely in USA
Remote
190K-250K Annually
Senior level
Big Data • HR Tech • Mobile • Software • Database
We Actively Connect People to Their Next Great Opportunity.
The Role
Designs, builds, deploys, and maintains scalable data pipelines, data lake systems, batch and streaming processing, MLOps frameworks, data documentation tooling, and an agentic data exploration platform. The role supports customer-facing products and enables engineering teams through reliable infrastructure, observability, data discovery, and AI capabilities.
Summary Generated by Built In

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission: 

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary: 

The Tech Enablement team is central to the velocity and quality of our entire engineering organization. Our mission is to build the scalable, reliable, and efficient infrastructure, tools, and processes that allow every product team to quickly deliver innovative products and services to our customers.

The Tech Enablement team ensures engineering efficiency and provides the foundational building blocks for the entire technology stack:

  • Data Infrastructure & Systems: We help developers at ZipRecruiter sustainably follow best practices and implement robust solutions by allowing engineers and data scientists to focus less on underlying technologies and more on building products and features that delight ZipRecruiter’s customers. To do this, the team builds, maintains, and drives adoption of tools for engineers that aid in data processing, dataset ingestion, dataset discoverability, data pipeline orchestration, data documentation, data analysis, building ML model pipelines, and running experiments.
  • AI Enablement: We help developers at ZipRecruiter leverage AI as a part of their tech stack by building and maintaining an agentic AI data exploration and analysis tool to democratize access to data, collaborate on insights, and accelerate data driven decision making. Starting from a natural language chat interface, the AI assisted tool assists with every aspect of using data, from finding the right data sources and writing queries to using them to visualize and analyze the results. We also manage an LLM Gateway which powers all of ZipRecruiter’s LLM usage in our customer facing products. 

Key Focuses:

As a Big Data Engineer in Tech Enablement, you will:

  • Data Ingestion & Datalake Management: Design, build, deploy, and maintain the data pipelines and systems that make web events available in our datalake and via event streams for various downstream applications to process.
  • Big Data Processing: You'll tackle challenges with large, evolving datasets, using a mix of batch and streaming techniques to make critical trade-offs between speed, efficiency, and reliability.
  • MLOps: Design, build, deploy, and maintain frameworks and systems that accelerate ML development across teams and products at ZipRecruiter, with the goals of improving the velocity, quality, observability, and reliability of ML development and ML powered products.
  • Data Documentation Framework: Design, build, deploy, and maintain frameworks and systems to improve the comprehensiveness and quality of data documentation at ZipRecruiter through processes and tooling that allows both humans and automated processes to easily add, maintain, and discover documentation.
  • Data Analysis Agent: Design, build, deploy, and maintain an agentic data exploration and analysis tool, Sift, to democratize access to data, collaborate on insights, and accelerate data driven decision making.

Minimum Qualifications:

  • 4+ years of professional software development experience, including building and operating data pipelines that feed into a customer facing product
  • Hands-on Apache Spark experience: writing, tuning and debugging batch and/or streaming jobs at scale
  • Experience deploying and operating containerized services and batch jobs
  • Solid computer science fundamentals: data structures, algorithms, distributed systems, and testing
  • Professional software development experience, including building and operating data pipelines and infrastructure that feed into a customer facing product

Preferred Qualifications:

  • 4+ years of professional software development experience with a focus on data-intensive systems
  • Working knowledge of AWS (S3, IAM, EC2, MSK or equivalents) and of instrumenting jobs with metrics, logs and alerts
  • Experience with a data lake stack: parquet on object storage, a data catalog such as AWS Glue, and an open table format such as Apache Iceberg or Delta Lake
  • Streaming experience: Kafka producers and consumers, Apache Flink, and/or Spark Structured Streaming
  • Experience with a workflow orchestrator such as Apache Airflow: authoring DAGs, backfills, dependency management and on-call for scheduled pipelines
  • Experience with open table format internals: schema evolution, partitioning, and compaction
  • Experience with deploying services on Kubernetes with Docker
  • Experience building and maintaining a data platform that powers a user-facing product including infrastructure and tools for streaming and batch data ingestion, building ETL pipelines, data permissions management, and data discovery.
  • BS/MS/PhD in Computer Science, Mathematics, Physics or a related field, or equivalent practical experience

As part of our team you’ll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $190,000 - $250,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote


ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: https://www.ziprecruiter.com/careers/job-applicant-privacy-notice

Skills Required

  • 4+ years of professional software development experience, including building and operating data pipelines that feed into a customer-facing product
  • Hands-on Apache Spark experience writing, tuning, and debugging batch and/or streaming jobs at scale
  • Experience deploying and operating containerized services and batch jobs
  • Solid computer science fundamentals, including data structures, algorithms, distributed systems, and testing
  • Professional software development experience building and operating data pipelines and infrastructure for customer-facing products
  • 4+ years of professional software development experience focused on data-intensive systems
  • Working knowledge of AWS, including S3, IAM, EC2, and MSK or equivalents
  • Experience instrumenting jobs with metrics, logs, and alerts
  • Experience with data lake stacks using Parquet, object storage, data catalogs such as AWS Glue, and open table formats such as Apache Iceberg or Delta Lake
  • Streaming experience with Kafka, Apache Flink, and/or Spark Structured Streaming
  • Experience with workflow orchestrators such as Apache Airflow, including DAG authoring, backfills, dependency management, and on-call support
  • Experience with open table format internals, including schema evolution, partitioning, and compaction
  • Experience deploying services on Kubernetes with Docker
  • Experience building and maintaining data platforms supporting user-facing products, including streaming and batch ingestion, ETL pipelines, data permissions, and data discovery
  • BS, MS, or PhD in Computer Science, Mathematics, Physics, or a related field, or equivalent practical experience

ZipRecruiter Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about ZipRecruiter and has not been reviewed or approved by ZipRecruiter.

  • Healthcare Strength — Comprehensive medical, dental, and vision coverage is described alongside life, disability, and pet insurance options. Mental-health resources, wellness programs, and wellness days further reinforce a broad health-and-wellbeing offering.
  • Retirement Support — A 401(k) with company matching is described as part of the core package. Equity-related programs such as an Employee Stock Purchase Plan and role-dependent RSUs complement retirement-oriented benefits.
  • Leave & Time Off Breadth — Flexible time off is presented as a major component of the overall rewards package. Paid holidays, sick time, and volunteer time are also included, expanding time-off options beyond standard PTO.

ZipRecruiter Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Monica, CA
1,100 Employees
Year Founded: 2010

What We Do

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as partnerships with the best job boards on the web. We're growing rapidly in pursuit of this mission, and we're always looking for talented people to join our team. Visit ziprecruiter.com/careers to view our open roles.

Why Work With Us

We are committed to nurturing an environment where every person feels welcomed, valued, heard, and respected. We embrace and encourage our employees’ differences, and we consistently review our overall equality—including recruitment and selection, compensation and benefits, promotions, and more—to stay relevant in this space.

Gallery

Gallery

Similar Jobs

ZipRecruiter Logo ZipRecruiter

Senior Software Engineer

Big Data • HR Tech • Mobile • Software • Database
In-Office or Remote
Santa Monica, CA, USA
1100 Employees
190K-250K Annually

Alloy Logo Alloy

Senior Solutions Architect

Fintech • Information Technology • Software • Financial Services
Easy Apply
Remote or Hybrid
USA
315 Employees
145K-175K Annually

Alloy Logo Alloy

Senior Solutions Architect

Fintech • Information Technology • Software • Financial Services
Easy Apply
Remote or Hybrid
USA
315 Employees
145K-175K Annually

Applied Systems Logo Applied Systems

Lead Product Manager

Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Remote or Hybrid
2 Locations
3116 Employees
135K-225K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account