Data Engineer Tech Lead

Posted Yesterday
Be an Early Applicant
Hiring Remotely in Israel
Remote or Hybrid
Senior level
Artificial Intelligence • Machine Learning • Retail • Software
The Role
Lead the architecture and development of large-scale batch and streaming data pipelines supporting real-time pricing decisions. Own data lake design, table modeling, partitioning, performance, cloud costs, data quality, observability, and reliability across AWS and GCP. Partner with backend, product, and data science teams on APIs and AI-driven data products. Mentor engineers, review designs and code, establish technical direction, and remain hands-on with implementation and delivery.
Summary Generated by Built In
Description

About Quicklizard

Quicklizard is a dynamic pricing platform used by leading retailers, marketplaces, and e-commerce brands worldwide. Our engine ingests sales, competitor, inventory, and cost data and turns it into real-time pricing recommendations - processing billions of records a day across multi-region pipelines that never stop running.

The Role

We're looking for a Data Engineering Tech Lead to own our data architecture end to end. You'll design, build, and scale the pipelines that power every pricing decision we make - from raw ingestion through our data lake to the analytics and BI layers our customers rely on. This is a hands-on leadership role: you'll set technical direction, drive architectural decisions, and mentor a team of data engineers, while still writing code and owning delivery.

What You'll Do

  • Architect and build large-scale batch and streaming ETL/ELT pipelines
  • Own data lake design, table modeling, and partitioning strategy across billion-row datasets
  • Drive query performance and cloud cost optimization across AWS and GCP
  • Establish data quality, observability, and reliability standards - freshness, correctness, and SLAs
  • Partner with backend, product, and data science teams to expose data through internal and customer-facing APIs
  • Lead technically: review designs and code, mentor engineers, and raise the bar for the data org

Our Stack

Spark / EMR · Airflow · BigQuery · PostgreSQL & Aurora · Kafka · RabbitMQ · Elasticsearch · Go · Python · AWS · GCP · Kubernetes · Terraform

What We're Looking For

  • 5+ years in data engineering, with real production experience at scale (terabytes+, billions of rows)
  • Deep SQL and strong distributed-processing experience (Spark or equivalent)
  • Strong Python and/or Go
  • Hands-on experience with cloud data warehouses (BigQuery, Snowflake, Redshift) and orchestration tooling
  • AI-first mindset - you actively work with AI coding tools (Claude Code, Cursor, Copilot) and LLM-based agents as part of your day-to-day, and look for opportunities to automate and accelerate engineering work with them
  • Experience building or supporting AI/LLM-driven data products - pipelines that feed models, agents, or ML systems
  • Proven technical leadership - mentoring engineers, owning architecture, driving decisions across teams
  • Product mindset: you care why the data is being used, not just that the job finished green

Nice to have: streaming architectures, cost/FinOps ownership, multi-region or multi-cloud systems, e-commerce or pricing domain experience, MCP servers or agentic tooling.

Skills Required

  • 5+ years of data engineering experience
  • Production experience processing terabytes of data and billions of rows
  • Deep SQL expertise
  • Strong distributed-processing experience with Spark or equivalent
  • Strong Python and/or Go skills
  • Hands-on experience with cloud data warehouses such as BigQuery, Snowflake, or Redshift
  • Experience with orchestration tooling
  • Experience using AI coding tools and LLM-based agents in daily engineering work
  • Experience building or supporting AI/LLM-driven data products
  • Proven technical leadership, including mentoring and architectural ownership
  • Product mindset focused on how data is used
  • Streaming architecture experience
  • Cost or FinOps ownership
  • Multi-region or multi-cloud systems experience
  • E-commerce or pricing domain experience
  • MCP servers or agentic tooling experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
97 Employees
Year Founded: 2010

What We Do

Quicklizard offers an ML- and AI-powered dynamic pricing platform for retailers and brands. Its software helps companies streamline and optimize pricing across product catalogs, channels, and markets, automating pricing decisions and supporting more confident, responsive retail strategies. The company applies machine learning and artificial intelligence to pricing optimization, enabling retailers and direct-to-consumer businesses to manage prices more efficiently and effectively at scale.

Similar Jobs

Tufin Logo Tufin

Technical Support

Security • Cybersecurity
Remote or Hybrid
Tel Aviv, ISR
500 Employees

Cloudera Logo Cloudera

Account Manager

Artificial Intelligence • Cloud • Software • Big Data Analytics
Remote
Israel
3092 Employees

Micron Technology Logo Micron Technology

Design Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
Remote
Israel
45000 Employees

GitLab Logo GitLab

Associate Renewals Manager

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
Israel
2500 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account