Senior data platform engineer

Posted 2 Hours Ago
Be an Early Applicant
Tel Aviv, ISR
Hybrid
Senior level
HR Tech • Sales • Software • Database • Business Intelligence
Build something extraordinary.
The Role
Own and evolve Lusha’s shared data platform across Databricks, Kafka, CDC, Airflow, Elasticsearch, AWS, Kubernetes, and databases. Build and operate reliable batch and streaming pipelines, improve performance and cost, establish governance and observability, automate manual processes, and lead cross-team architecture initiatives. The role also requires daily use of AI coding tools and building LLM, agent, and MCP-based platform workflows.
Summary Generated by Built In
Description

At Lusha, we're building for builders. We build fast and AI-first, so we look for builders. By a builder, we mean someone who turns "maybe" into "done".

We're looking for a Senior Data Platform Engineer to join the Data Platform team, which owns the infrastructure every data team at Lusha runs on and sits between DevOps and the Data groups. You'll be the Databricks admin (Unity Catalog, compute, governance, cost), the Confluent (Kafka) and CDC admin, and own Airflow, Elasticsearch, the databases, the data S3 estate, and the Kubernetes cluster underneath. Your job is to make the platform fast, cheap, governed, and boring: if it's broken, you fix it, if it's manual, you automate it.

Hands-on experience using AI coding tools daily, and building or integrating LLM and agent tooling into real workflows, is a must for this role.

This role is based in Tel Aviv. We work in a hybrid model, with 3 days a week in the office.

This might be for you if:

  • You enjoy designing, building, and running large scale batch and streaming data pipelines in production, and owning what you ship, including when it breaks
  • You like administering and evolving core platforms: Databricks, Confluent Kafka and CDC pipelines, Airflow, and Elasticsearch
  • You care about reliability, performance, and cost of a shared data platform used across R&D
  • You enjoy setting the engineering standard for data work: testing, observability, cost tagging, documentation
  • You like driving architecture decisions across Databricks, Kafka, Elasticsearch, and AWS
  • You actively use AI tools and build self-service tooling, including MCP servers and agent interfaces, so teams can operate the platform safely
Requirements
  • 5+ years hands-on building and operating large scale data pipelines, batch and streaming, in production
  • Deep Spark and Databricks experience: Delta Lake, Unity Catalog, job and cluster tuning, Structured Streaming or DLT
  • Streaming and CDC experience: Kafka (Confluent a plus), Debezium or equivalent, schema evolution and its failure modes
  • Experience writing Airflow DAGs and operating the platform itself
  • Expert Python and SQL, clean, tested, performant
  • Strong data modeling and architecture judgment, with the ability to explain tradeoffs in scale, performance, and cost
  • Infra literacy: comfortable with AWS (S3, IAM, networking basics), Terraform, Docker and Kubernetes, and CI/CD
  • Proven experience leading cross-team technical initiatives end to end, from ambiguous ask to shipped and adopted
  • Proven experience using AI coding tools daily, with LLM and agent tooling (MCP, embeddings, vector search) built into real workflows

Nice to have:

  • Elasticsearch at scale: indexing pipelines, cluster operations, reindex and rollout strategies
  • FinOps or cloud cost management for data platforms
  • Vault or similar secrets management, and Kubernetes operations beyond deploying your own service
  • Experience inheriting a system with real debt and making it boring

Skills Required

  • 5+ years of hands-on experience building and operating large-scale production data pipelines, including batch and streaming
  • Deep experience with Spark and Databricks, including Delta Lake, Unity Catalog, job and cluster tuning, Structured Streaming, or Delta Live Tables
  • Streaming and CDC experience with Kafka, preferably Confluent Kafka, and Debezium or equivalent
  • Experience with schema evolution and CDC failure modes
  • Experience writing Airflow DAGs and operating the Airflow platform
  • Expert Python and SQL skills, including clean, tested, and performant code
  • Strong data modeling and architecture judgment, including scale, performance, and cost tradeoffs
  • Experience with AWS, including S3, IAM, and networking basics
  • Experience with Terraform, Docker, Kubernetes, and CI/CD
  • Proven experience leading cross-team technical initiatives from ambiguous requirements through adoption
  • Daily use of AI coding tools and experience building LLM and agent tooling into real workflows
  • Experience with MCP, embeddings, or vector search
  • Experience with Elasticsearch at scale, including indexing pipelines, cluster operations, reindexing, and rollout strategies
  • FinOps or cloud cost management experience for data platforms
  • Experience with Vault or similar secrets management
  • Advanced Kubernetes operations beyond deploying an individual service
  • Experience inheriting systems with technical debt and improving their reliability and maintainability

Lusha Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Lusha and has not been reviewed or approved by Lusha.

  • Healthcare Strength Health coverage is described as robust, including an option for a fully covered individual plan plus dental, vision, life, and disability. Feedback suggests employer-paid individual medical options and comprehensive plan choices are available.
  • Wellbeing & Lifestyle Benefits Everyday perks such as meal stipends, snacks, commuter benefits and paid parking combine with wellness offerings like subsidized gym, fitness classes, and annual screenings. These lifestyle benefits are consistently featured for office-based teams.
  • Retirement Support A 401(k) plan is offered to support retirement savings. This is explicitly included alongside compensation packages in U.S. listings.

Lusha Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Boston, MA
300 Employees
Year Founded: 2016

What We Do

At Lusha, we're building a future where every B2B sales professional is equipped with the data they need to succeed. Founded in 2016 by Assaf Eisenstein and Yoni Tserruya, our mission is to organize the world's business data while empowering our customers to uncover relevant revenue and growth opportunities. We're proudly GDPR compliant and maintain a globally compliant database. With a staggering reach of 1 million users and a database boasting over 200 million entries, including 45 million direct contacts in North America, 50 million enterprise and SMB business profiles, and 21 million GDPR-compliant European contacts, Lusha stands as an indispensable resource in the B2B landscape. Our community has surged to over 670,000 sales professionals and 223,000 sales organizations, proudly showcasing partners such as Zendesk, Google, and Yotpo. With significant investments totaling $240 million, we've transitioned from our bootstrap origins to unicorn status with a value estimation of $1.5 billion. Starting as a profitable bootstrap company and surviving solely on profits for 4.5 years, our journey is a testament to our commitment to innovation and the iconic brand we've become, continuously setting new standards in the industry. In total, Lusha has 300 employees globally in two sites—Tel Aviv and Boston. Our teams are the driving force behind everything we do, dedicated not only to meeting but exceeding our customers' needs. We understand the importance of connection, fostering a collaborative environment where every employee contributes to our success. Your voice matters, your ideas count, and together, we'll thrive. Join us on this journey to revolutionize B2B sales. Let's grow better together.

Why Work With Us

Welcome to Lusha, where culture isn't a label—it's our DNA. Dream-driven creators, user-centric innovators, and relentless learners, we thrive on simplicity, collaboration, and trust. Join us in shaping a company we're proud of—one where every voice matters and dreams fuel our journey.

Gallery

Gallery

Similar Jobs

Hybrid
Tel Aviv, ISR
1064 Employees

Orca AI Logo Orca AI

Platform Engineer

Artificial Intelligence • Computer Vision • Transportation
Remote or Hybrid
Israel
163 Employees

Cyera Logo Cyera

Senior Data Engineer

Software • Cybersecurity
In-Office
Tel Aviv, ISR
1200 Employees

Sequencing.com Logo Sequencing.com

Senior Back-end Engineer

Big Data • Healthtech • Software • Biotech
In-Office or Remote
109 Locations
39 Employees

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account