Lead Data Engineer

Posted 3 Days Ago
Be an Early Applicant
New York, NY, United States
In-Office
145K-150K Annually
Entry level
Software
The Agentic Commerce Orchestration Engine
The Role
Lead hands-on data engineering delivery across analytics and data platform initiatives. Responsibilities include designing Medallion architecture transformations, building Gold-layer data models, implementing complex PySpark and Databricks transformations, improving pipeline reliability, coordinating contractors, planning sprint execution, reviewing pull requests, and communicating risks and dependencies. The role also supports GDPR-first, multi-instance data strategies and external analytics consumption.
Summary Generated by Built In

Job Summary

We are hiring a Lead Data Engineer to drive delivery across our analytics and data platform initiatives. This role is a hands-on technical lead responsible for translating well-defined engineering specifications into executable work, coordinating a small team of contractors, and ensuring consistent, high-quality progress.

You will partner closely with an Engineering Manager who owns architectural direction and high-level specifications. Your focus will be execution leadership: refining specifications into agile workloads, assigning work effectively, contributing directly to complex implementations, and clearly communicating progress, risks, and areas requiring clarification.

At Logicbroker, AI-driven development isn't a future initiative. Our engineering team has been an early adopter, building its own AI implementations and integrating emerging technologies into everyday development workflows. We're looking for a technical leader who is excited to embrace AI-assisted development, drive engineering efficiency, and help shape how we continue to innovate and deliver at scale.

Work Authorization: Applicants must be legally authorized to work in the United States. Logicbroker is unable to provide employment visa sponsorship for this position, now or in the future.

What You'll Do:

  • Lead a small delivery team and act as a player-coach by owning the most complex data transformations and modeling work, while reviewing and guiding contractor contributions.
  • Keep work unblocked, well-scoped, and on track to ensure consistent delivery of momentum.
  • Continue building and refining analytics foundations driven by Gold-layer data models.
  • Design and implement Medallion architecture transformations (Bronze → Silver → Gold).
  • Ensure Gold-layer outputs are well-modeled, performant, and consistently consumable by an external analytics engine.
  • Improve the reliability, clarity, and maintainability of existing pipelines.
  • Partner with the Engineering Manager to execute an approved Data Warehouse Unification Plan RFC.
  • Plan and deliver sprint-based execution, with execution as the primary focus given the RFC is already defined.
  • Work across multiple Databricks instances as part of a GDPR-first data strategy.
  • Surface execution risks, sequencing concerns, and dependencies early to support successful delivery.
  • Translate engineering specifications into clear, scoped tickets, logical sprint plans, and well-sequenced workstreams.
  • Assign work appropriately across contractors based on skill level and complexity.
  • Implement complex Spark and Databricks transformations directly as needed.
  • Review pull requests and uphold quality standards across all delivered work.
  • Communicate progress, blockers, and clarity needs clearly and proactively with stakeholders.
  • Maintain delivery momentum without unnecessary process overhead. 

What We Need:

  • Strong hands-on experience with Databricks, PySpark, and Spark SQL  
  • Proven experience implementing Medallion architecture  
  • Solid data modeling skills, especially for analytics and reporting use cases  
  • Experience leading delivery for small engineering teams (formal management not required)
  • Comfort working with partially defined requirements and refining them collaboratively  
  • Clear written and verbal communication skills
    Nice to Have:
  • Experience supporting GDPR-compliant data strategies  
  • Exposure to multi-region or multi-tenant data platforms  
  • Familiarity with external analytics tools consuming warehouse data  
  • Familiarity with various data flows, with sources in Azure, AWS, GCP, and others 

Why Logicbroker: 

Mission-Driven Culture: Be part of a company transforming digital commerce through innovation and agility—your work directly shapes how global brands connect with customers.

Collaborative, No-Ego Environment: We believe the best ideas win, not the loudest voices. You’ll work alongside teammates who challenge and support each other.

Flexibility with High-Performance Energy: Whether remote or in-office, we foster autonomy and accountability—because we trust you to own your success.

Leadership That Listens: Our executives are not just accessible—they’re invested in your growth, open to your ideas, and committed to building a company where people thrive.

Celebrated Wins, Shared Learnings: From team offsites to Slack shoutouts, we celebrate progress and learn from setbacks together

Skills Required

  • Legally authorized to work in the United States
  • Strong hands-on experience with Databricks, PySpark, and Spark SQL
  • Proven experience implementing Medallion architecture
  • Solid data modeling skills for analytics and reporting use cases
  • Experience leading delivery for small engineering teams; formal management is not required
  • Ability to work with partially defined requirements and refine them collaboratively
  • Clear written and verbal communication skills
  • Experience supporting GDPR-compliant data strategies
  • Exposure to multi-region or multi-tenant data platforms
  • Familiarity with external analytics tools consuming warehouse data
  • Familiarity with data flows from Azure, AWS, GCP, and other sources
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, New York
95 Employees

What We Do

Logicbroker is the Agentic Commerce Orchestration Engine helping enterprise retailers, brands, suppliers, and distributors connect and grow. Our Intelligent Commerce Network powers over $10B in GMV for global leaders like Samsung, Walgreens, and Home Depot by automating the entire process from discovery to doorstep and stock to dock. We make products discoverable, shoppable, fulfillable, and returnable so our clients can grow faster, delight customers, and run smarter operations.

Similar Jobs

In-Office
New York, NY, USA
95 Employees
Hybrid
New York, NY, USA
289097 Employees
In-Office
3 Locations
257 Employees
125K-175K Annually

Capital Group Logo Capital Group

Data Engineer

Fintech • Financial Services
In-Office
2 Locations
8820 Employees
202K-342K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account