Lead Data Engineer/ Data Architect

Reposted 6 Days Ago
Be an Early Applicant
Hiring Remotely in Hyderabad, Telangana, IND
In-Office or Remote
Expert/Leader
Cloud • Database
The Role
Design, develop, and modernize enterprise-scale Azure data platforms. Lead solution architecture, refactor and optimize PySpark/Databricks pipelines, implement ETL/ELT and lakehouse/warehousing solutions, ensure performance, data quality, governance, and mentor junior engineers.
Summary Generated by Built In

Enable Data seeking an experienced Azure Data Architect with strong hands-on engineering expertise to design, develop, optimize, and modernize enterprise-scale data platforms. The role combines solution architecture, technical leadership, and individual contributor responsibilities, requiring deep expertise in Azure data services, data engineering best practices, and large-scale data processing using PySpark, Python, SQL, and Azure Databricks.

The ideal candidate will be responsible for analyzing existing data products and pipelines, identifying improvement opportunities, leading refactoring and redesign initiatives, and implementing scalable, reliable, and high-performance data solutions on Azure.

Responsibilities
  • Architecture & Solution Design
  • Overall 15+ years of experience with 10+ years of experience in Data Engineering and Analytics solutions.
  • Design end-to-end data architectures on Microsoft Azure.
  • Define data ingestion, transformation, storage, governance, and consumption strategies.
  • Create scalable, secure, and cost-effective data solutions aligned with business objectives.
  • Establish architectural standards, design patterns, and best practices for data engineering teams.
  • Collaborate with business stakeholders, product owners, and technical teams to translate requirements into technical solutions.
  • Design, develop, and modernize enterprise data platforms on Azure. Analyze, refactor, and redesign existing data pipelines and products while building new scalable data solutions.
  • Act as a hands-on individual contributor with technical leadership responsibilities, including mentoring junior developers and driving best practices.
  • Strong hands-on experience in PySpark, Python, and SQL
  • Expertise in Azure Databricks and Azure data ecosystem
  • Experience designing and implementing scalable data architectures
  • Ability to analyze, optimize, refactor, and redesign existing data pipelines
  • Develop and maintain ETL/ELT solutions and data products
  • Performance tuning, troubleshooting, and data quality implementation
  • Mentor and guide junior developers and conduct code reviews
  • Collaborate with cross-functional teams to deliver end-to-end data solutions
    Required Experience


Requirements
  • Azure Data Lake, Azure Data Factory, Azure Synapse
  • Data warehousing, lakehouse architecture, and cloud migration
  • CI/CD, Git, and Agile development practices
  • Role Type: Senior Individual Contributor with Technical Leadership responsibilities.

Skills Required

  • 15+ years overall experience with 10+ years in Data Engineering and Analytics solutions
  • Design end-to-end data architectures on Microsoft Azure
  • Azure Data Lake
  • Azure Data Factory
  • Azure Synapse
  • Azure Databricks
  • Strong hands-on experience with PySpark
  • Strong hands-on experience with Python
  • Strong hands-on experience with SQL
  • Data warehousing, lakehouse architecture, and cloud migration experience
  • Develop and maintain ETL/ELT solutions and data products
  • Experience designing and implementing scalable data architectures
  • Performance tuning, troubleshooting, and data quality implementation
  • CI/CD and Git experience
  • Familiarity with Agile development practices
  • Technical leadership and mentoring junior developers; conduct code reviews
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Minneapolis, MN
19 Employees
Year Founded: 2018

What We Do

Enable Data specializes in advanced data, application and cloud solutions working on cutting-edge projects driving innovation and transformation for our customers. We empower our customers to leverage modern solutions to deliver increased value across their business ecosystem. We help clients by providing consulting, managed project and staff augmentation services working with clients across various industries including healthcare, financial, media, insurance, and manufacturing.

Similar Jobs

Rubrik Logo Rubrik

GAM - Indian GSIs

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Remote
India
3000 Employees

Zapier Logo Zapier

Senior Engineer

Artificial Intelligence • Productivity • Software • Automation
Remote
India
800 Employees

Pfizer Logo Pfizer

Associate Manager, Medical Communications and Content Solutions -Vaccines

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote
India
121990 Employees

Pfizer Logo Pfizer

Manager, Medical Communications and Content Solutions- Vaccines

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote
India
121990 Employees

Similar Companies Hiring

NetBox Labs Thumbnail
Cloud • Software
US
125 Employees
Toro TMS Thumbnail
Cloud • Enterprise Web • Sales • Software • Transportation
Chicago, IL
80 Employees
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account