Data Engineer

Posted 24 Days Ago
Be an Early Applicant
Tel Aviv, ISR
In-Office
Mid level
Software
The Role
The Senior Data Engineer will build and own the ClickHouse analytics platform, lead data migrations, optimize queries, and ensure ingest reliability while educating the team.
Summary Generated by Built In
Description

Zafran is building the next generation of vulnerability and risk management. We’re moving the analytical heart of our investigation product from various of DBs into ClickHouse - and we need a Senior Data Engineer to be the owner, builder, and guardian of that warehouse.This is the team’s first dedicated data engineering hire. You’ll set standards, build new pipelines, and partner closely with the engineers who power our customer-facing dashboards and investigation data layer.

About Zafran:

Our Mission: To stop the exploitation of vulnerabilities, everywhere.

What makes us different: Zafran de-risks 90% of critical vulnerabilities overnight across your hybrid environment and utilizes Agentic Capabilities and your existing security tools to rapidly mitigate and remediate the 10% most likely to be exploited.

​​Who’s behind us: Zafran is backed by Menlo Ventures, Sequoia Capital, Cyberstarts, and a deep belief that cybersecurity should move as fast as attackers do. We’re one of the fastest-growing companies in the industry, scaling to meet demand from the world’s most advanced, security-obsessed organizations.

We’re serious about our mission- so expect work that matters, teammates who challenge and inspire you, and plenty of fun along the way!

What you will do:

  • Build and own Zafran’s ClickHouse analytics platform - schemas, ingest, pipelines, and the services that drive them.
  • Lead migrations moving all data types onto ClickHouse, end-to-end.
  • Set the standard for schema design, migration safety, and query patterns. Review designs before they land.
  • Profile and optimize queries powering data investigation all over the platform - design materialized views, projections, and rewrites where they help.
  • Own ingest reliability - Kafka-to-ClickHouse ingestion, backfill tooling, and tenant-aware data quality monitoring.
  • Manage cost and capacity as data volume grows - storage tuning, query-cost monitoring, capacity planning across many tenants.
  • Educate the team - write playbooks, run design reviews, raise the bar on how the engineering org thinks about analytical data.
Requirements
  • 4-6 years of data engineering experience with 2+ years hands on with ClickHouse in production.
  • Deep knowledge of ClickHouse internals: the MergeTree family, partitioning and ordering tradeoffs, materialized views, projections, FINAL semantics, TTLs, LowCardinality, ARRAY JOINs, data-skipping indexes.
  • Streaming ingest experience with Kafka of equivalent: consumer groups, batching, idempotency, backfill.
  • Schema migration discipline - comfort with append-only / immutable migration patterns and reasons behind them.
  • Experience with multi-tenant data architectures.

Nice to have

  • Background in security data (CTEM, etc..)
  • Previous experience being the first data engineer.

Skills Required

  • 4-6 years of data engineering experience with 2+ years hands on with ClickHouse in production
  • Deep knowledge of ClickHouse internals
  • Streaming ingest experience with Kafka
  • Schema migration discipline
  • Experience with multi-tenant data architectures
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, New York
99 Employees

What We Do

The Zafran Threat Exposure Management Platform is the first and only consolidated platform that integrates with your security tools to reveal, remediate, and mitigate the risk of exposures across your entire infrastructure. Zafran uses an agentless approach to reveal what is truly exploitable, while reducing manual prioritization and remediation through automated response workflows. https://www.zafran.io/

Similar Jobs

Bringg Logo Bringg

Data Engineer

Cloud • Enterprise Web • Logistics • Software
Hybrid
Tel Aviv, ISR
180 Employees

CrowdStrike Logo CrowdStrike

Senior Data Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
Tel Aviv, ISR
10000 Employees
Remote or Hybrid
Israel
259 Employees
5-5 Annually

evoke Logo evoke

Data Engineer

Gaming • News + Entertainment
Remote or Hybrid
Israel
1399 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
31 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account