Lead Data Engineer

Posted 4 Days Ago
Be an Early Applicant
Hiring Remotely in Dubai, ARE
Remote
Expert/Leader
Artificial Intelligence • Information Technology • Software
The Role
Lead end-to-end data engineering delivery for client engagements by architecting and deploying production-grade pipelines, lakehouses, warehouses, and analytics datasets. Establish engineering standards for testing, CI/CD, governance, security, monitoring, and documentation. Resolve complex technical issues, conduct code reviews, mentor engineers, and advise client stakeholders on scalable data platforms supporting analytics, machine learning, and generative AI.
Summary Generated by Built In

DeepLight AI is a specialist AI and data consultancy dedicated to helping organisations turn complex data into secure, scalable, and actionable business capability. Based in the UAE, DeepLight partners with clients across a range of industries to design and deliver tailored data, analytics, and AI solutions.

DeepLight does not take a one-size-fits-all approach. We work with clients to understand their business context, existing technology landscape, and strategic goals, then design solutions that integrate effectively into their enterprise architecture. From building robust data foundations to enabling advanced analytics and AI platforms, we help clients create practical, high-impact intelligent systems that are secure, scalable, and aligned to business value.

We are looking for a Lead Data Engineer who thrives at the intersection of hands-on technical excellence, architectural vision, and team leadership. If you love solving complex data challenges, setting engineering benchmarks, and shaping real-world solutions directly with clients, this is your stage.

The Opportunity

As a Lead Data Engineer, you will be the primary technical authority driving data engineering for high-profile client engagements. This is a high-impact, hands-on leadership role where you will design production-grade platforms, elevate engineering quality, and mentor the next generation of talent.

You’ll be leading by example—balancing rapid delivery with long-term engineering rigor, making pragmatic architectural decisions, and serving as a trusted technical advisor to client stakeholders.

What You’ll Do

Drive End-to-End Delivery

  • Architect, build, and deploy production-grade data pipelines, lakehouses, and analytics-ready datasets.
  • Turn complex business problems into clear technical designs, delivery roadmaps, and actionable engineering tasks.
  • Stay hands-on: solve tough technical challenges, perform code reviews, and jump in on production issue resolution.

Raise the Engineering Bar

  • Establish and champion best-in-class standards for code quality, testing, CI/CD, documentation, and data governance.
  • Build resilient, monitored, and secure data pipelines designed for scale and enterprise compliance.
  • Drive operational excellence across version control, automated testing, runbooks, and platform monitoring.

Inspire & Influence

  • Coach and Mentor mid and senior level engineers, fostering a high-performance culture grounded in technical discipline and continuous growth.
  • Partner directly with client architects, data scientists, and business leaders, translating complex technical choices into clear business value.

As an AI consultancy, our greatest asset is the expertise of our people.
While technical mastery is the foundation of what we do, the ability to bridge the gap between complex data science and actionable business value is what defines your success with Deeplight.
We're looking for individuals who are not only world-class in their fields of specialism, but also compelling communicators and persuasive advocates for their own skills.
You will be the face of our firm, tasked with building trust, articulating the "why" behind your technical decisions, and effectively "selling" your vision to high-level stakeholders.
If you thrive on the challenge of presenting cutting-edge solutions as much as you do on building them, you will fit right in.


RequirementsWhat We’re Looking For
  • Advanced proficiency in Python and SQL with a proven track record of delivering end-to-end ETL/ELT pipelines and scalable data architectures.
  • Hands-on expertise with at least one major cloud provider (AWS, Azure, GCP) and deep proficiency in platforms like Databricks, Snowflake, Microsoft Fabric, Synapse, BigQuery, or Redshift.
  • Deep understanding of data lakes, lakehouses, warehouses, streaming vs. batch processing, orchestration, and production monitoring.
  • Solid grasp of data privacy, access control, encryption, schema management, and enterprise data quality frameworks.
  • Excellent communication skills with the ability to navigate client environments, guide stakeholders, and balance delivery pace with technical quality.
  • Strong understanding of how robust data engineering enables advanced analytics, machine learning, and Generative AI applications.

Why Join DeepLight AI?
  • Lead critical, high-visibility engineering initiatives across top-tier client environments.
  • Work with cutting-edge cloud and AI technologies in a collaborative, fast-evolving consultancy environment.
  • Join a team that values technical mastery, pragmatic leadership, and continuous innovation.

Benefits

The benefits you'll enjoy as part of this role include:

  • Competitive salary.
  • Comprehensive personal health insurance.
  • Full Individual Visa Sponsorship.
  • Professional development and certification support.
  • Subscription reimbursement relating to your role.
  • Opportunity to work on cutting-edge AI projects.
  • Monthly Employee Incentive program.
  • Career advancement opportunities in a rapidly growing AI company.

This position offers a unique opportunity to shape the future of AI implementation while working with a talented team of professionals at the forefront of technological innovation. The successful candidate will play a crucial role in driving our company's success in delivering transformative AI solutions to our clients.
At DeepLight AI, we recognise that diversity drives innovation. We are committed to fostering an inclusive environment where individuals with different thinking styles can thrive and contribute their unique strengths to our specialised AI and data solutions.

Our goal is to ensure our application and interview process is accessible, predictable, and fair for all candidates.

If you require any specific adjustments to the application process, or if you require any reasonable adjustments should you be successful in being processed to the interview stage, please do let us know. This information will be kept strictly confidential and will not impact hiring decisions.

Skills Required

  • Advanced proficiency in Python and SQL.
  • Proven experience delivering end-to-end ETL/ELT pipelines and scalable data architectures.
  • Hands-on expertise with at least one major cloud provider: AWS, Azure, or GCP.
  • Deep proficiency in one or more of Databricks, Snowflake, Microsoft Fabric, Synapse, BigQuery, or Redshift.
  • Deep understanding of data lakes, lakehouses, warehouses, streaming and batch processing, orchestration, and production monitoring.
  • Understanding of data privacy, access control, encryption, schema management, and enterprise data quality frameworks.
  • Excellent communication skills for navigating client environments and guiding stakeholders.
  • Strong understanding of data engineering foundations supporting advanced analytics, machine learning, and generative AI applications.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Dubai
19 Employees

What We Do

Welcome to Deeplight, the pioneering consultancy dedicated to guiding businesses through every facet of the AI adoption journey. From initial industry awareness to seamless integration and optimization, Deeplight is your strategic partner for unlocking the full potential of Artificial Intelligence. The Enterprise Innovation Roadmap: Navigating Your AI Journey EXECUTIVE COACHING: Propel your leadership team to new heights with personalized coaching driven by AI insights and guidance. Deeplight ensures your leadership makes informed decisions and drives innovation at the highest level. CURRENT STATE ASSESSMENT: Embark on your AI journey with clarity by conducting a data-driven assessment. Gain a comprehensive understanding of your organization's AI readiness, identifying key strengths, weaknesses, and opportunities to maximize your return on AI investment. DATA READINESS INITIATIVES: Elevate your data game with Deeplight's tailored data cleansing, organization. Bridge the gap between your current data and the needs of successful AI implementation, ensuring your AI models have the fuel they need to thrive. USE CASE WORKSHOPS: Collaboratively explore the most impactful AI applications for your unique business needs. Deeplight facilitates brainstorming sessions, feasibility studies, and prioritization to identify use cases with the highest potential for success. Turn ideas into actionable strategies with our expert guidance. CUSTOM MODEL DESIGN: Deeplight goes beyond basic AI models with custom "AiGent" design. Craft intelligent agents tailored to your challenges and goals, ensuring optimal performance and alignment with your strategic vision. Redefine what's possible with AI for your business. Ready to elevate your business through the power of AI? Deeplight serves as your beacon of innovation, guiding businesses through the complex process of AI adoption. Connect with us to embark on a transformative AI journey that propels your enterprise to new heights.

Similar Jobs

Mastercard Logo Mastercard

Director, Business Development - Digital Partnerships Enabler

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Remote or Hybrid
Dubai, ARE
38800 Employees

Mastercard Logo Mastercard

Senior Counsel

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Remote or Hybrid
Dubai, ARE
38800 Employees

Mastercard Logo Mastercard

Manager, Network Performance & Analytics

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Remote or Hybrid
Dubai, ARE
38800 Employees

Mastercard Logo Mastercard

The Manager, Specialist Sales- Digital Payments, East Arabia

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Remote or Hybrid
Dubai, ARE
38800 Employees

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account