Lead Data Engineer

Posted 22 Days Ago
Be an Early Applicant
Bengaluru, Karnataka, IND
In-Office
Senior level
Artificial Intelligence • Information Technology • Analytics • Consulting
The Role
Lead the design and development of scalable Azure data pipelines and ETL/ELT solutions using Python, PySpark, SQL, Databricks, Data Factory, Synapse, and related Azure services. Provide technical leadership through code reviews, documentation, troubleshooting, mentoring, and engineering best practices. Collaborate with cross-functional teams to translate business requirements into technical solutions and support data warehousing, lakehouse architecture, and governance initiatives.
Summary Generated by Built In
Lead Data EngineerRole Overview
We are looking for a Lead Data Engineer with strong experience in Azure Data Engineering, Python/PySpark, SQL, and Data Warehousing. The role involves designing scalable data pipelines, leading Azure ETL solutions, and providing technical guidance to the team.
Key Responsibilities
  • Design and develop scalable data pipelines using Python/PySpark.
  • Architect and implement Azure ETL/ELT solutions using Databricks, Data Factory, Blob Storage, Synapse, Azure SQL, and Lakebase.
  • Work with cross-functional teams to translate business requirements into technical solutions.
  • Lead code reviews, ensure engineering best practices, and maintain technical documentation.
  • Mentor junior engineers and provide technical leadership.
  • Troubleshoot data, pipeline, and performance issues.
  • Use Git, Azure DevOps, and Jira for source control and project delivery.
Required Skills
  • 8+ years of experience in Data Engineering/Data Warehousing.
  • 5+ years of experience with Python/PySpark.
  • 8+ years of experience with SQL, including complex queries, stored procedures, and functions.
  • Strong experience with Azure Databricks, Data Factory, Blob Storage, Synapse, Azure SQL, Lakebase, and Unity Catalog.
  • Knowledge of Azure Functions, Logic Apps, Azure VMs, Git, and Azure DevOps.
  • Strong problem-solving, communication, and leadership skills.
Preferred
  • Azure Data Engineer certification is a plus.
  • Experience with Lakehouse architecture and data governance.
Role Details
Role: Lead Data Engineer
Employment: Full-Time, Permanent
Experience: 8+ Years
Education: B.Tech/B.E., BCA, B.Sc., or any relevant postgraduate qualification

Skills Required

  • 8+ years of experience in data engineering or data warehousing
  • 5+ years of experience with Python and PySpark
  • 8+ years of experience with SQL, including complex queries, stored procedures, and functions
  • Strong experience with Azure Databricks, Data Factory, Blob Storage, Synapse, Azure SQL, Lakebase, and Unity Catalog
  • Knowledge of Azure Functions, Logic Apps, Azure Virtual Machines, Git, and Azure DevOps
  • Strong problem-solving, communication, and leadership skills
  • Azure Data Engineer certification
  • Experience with lakehouse architecture and data governance
  • B.Tech, B.E., BCA, B.Sc., or relevant postgraduate qualification
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kolkata
92 Employees
Year Founded: 2019

What We Do

InXiteOut is a strategic AI and data analytics partner for enterprises. It advises, architects, builds, and deploys production-grade AI solutions, data platforms, analytics systems, custom applications, and automation. The company helps organizations identify high-value use cases, turn complex data into actionable intelligence, and embed AI into daily workflows, enabling faster decisions, smarter operations, measurable business impact, and scalable growth across industries.

Similar Jobs

Relanto Logo Relanto

Lead Data Engineer

Information Technology • Professional Services • Consulting
In-Office
Bengaluru, Karnataka, IND
500 Employees

Optum Logo Optum

Lead Full-stack Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
160000 Employees

Labcorp Logo Labcorp

Lead Data Engineer

Healthtech • Biotech
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
19796 Employees

Brillio Logo Brillio

Lead Data Engineer

Information Technology
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
2676 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account