Lead Data Engineer/ Data Architect

Posted 12 Days Ago
Be an Early Applicant
Hiring Remotely in Hyderabad, Telangana, IND
In-Office or Remote
Expert/Leader
Cloud • Database
The Role
Design, develop, and modernize enterprise-scale Azure data platforms. Lead solution architecture, refactor and optimize PySpark/Databricks pipelines, implement ETL/ELT and lakehouse/warehousing solutions, ensure performance, data quality, governance, and mentor junior engineers.
Summary Generated by Built In

Enable Data seeking an experienced Azure Data Architect with strong hands-on engineering expertise to design, develop, optimize, and modernize enterprise-scale data platforms. The role combines solution architecture, technical leadership, and individual contributor responsibilities, requiring deep expertise in Azure data services, data engineering best practices, and large-scale data processing using PySpark, Python, SQL, and Azure Databricks.

The ideal candidate will be responsible for analyzing existing data products and pipelines, identifying improvement opportunities, leading refactoring and redesign initiatives, and implementing scalable, reliable, and high-performance data solutions on Azure.

Responsibilities
  • Architecture & Solution Design
  • Overall 15+ years of experience with 10+ years of experience in Data Engineering and Analytics solutions.
  • Design end-to-end data architectures on Microsoft Azure.
  • Define data ingestion, transformation, storage, governance, and consumption strategies.
  • Create scalable, secure, and cost-effective data solutions aligned with business objectives.
  • Establish architectural standards, design patterns, and best practices for data engineering teams.
  • Collaborate with business stakeholders, product owners, and technical teams to translate requirements into technical solutions.
  • Design, develop, and modernize enterprise data platforms on Azure. Analyze, refactor, and redesign existing data pipelines and products while building new scalable data solutions.
  • Act as a hands-on individual contributor with technical leadership responsibilities, including mentoring junior developers and driving best practices.
  • Strong hands-on experience in PySpark, Python, and SQL
  • Expertise in Azure Databricks and Azure data ecosystem
  • Experience designing and implementing scalable data architectures
  • Ability to analyze, optimize, refactor, and redesign existing data pipelines
  • Develop and maintain ETL/ELT solutions and data products
  • Performance tuning, troubleshooting, and data quality implementation
  • Mentor and guide junior developers and conduct code reviews
  • Collaborate with cross-functional teams to deliver end-to-end data solutions
    Required Experience


Requirements
  • Azure Data Lake, Azure Data Factory, Azure Synapse
  • Data warehousing, lakehouse architecture, and cloud migration
  • CI/CD, Git, and Agile development practices
  • Role Type: Senior Individual Contributor with Technical Leadership responsibilities.

Skills Required

  • 15+ years overall experience with 10+ years in Data Engineering and Analytics solutions
  • Design end-to-end data architectures on Microsoft Azure
  • Azure Data Lake
  • Azure Data Factory
  • Azure Synapse
  • Azure Databricks
  • Strong hands-on experience with PySpark
  • Strong hands-on experience with Python
  • Strong hands-on experience with SQL
  • Data warehousing, lakehouse architecture, and cloud migration experience
  • Develop and maintain ETL/ELT solutions and data products
  • Experience designing and implementing scalable data architectures
  • Performance tuning, troubleshooting, and data quality implementation
  • CI/CD and Git experience
  • Familiarity with Agile development practices
  • Technical leadership and mentoring junior developers; conduct code reviews
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Minneapolis, MN
19 Employees
Year Founded: 2018

What We Do

Enable Data specializes in advanced data, application and cloud solutions working on cutting-edge projects driving innovation and transformation for our customers. We empower our customers to leverage modern solutions to deliver increased value across their business ecosystem. We help clients by providing consulting, managed project and staff augmentation services working with clients across various industries including healthcare, financial, media, insurance, and manufacturing.

Similar Jobs

Zscaler Logo Zscaler

Integration Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
India
8697 Employees

Motive Logo Motive

Product Manager

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
Remote
India
4000 Employees

ServiceNow Logo ServiceNow

Financial Analyst

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Hyderabad, Telangana, IND
29000 Employees

Optum Logo Optum

Senior Data Analyst

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Remote
India
160000 Employees

Similar Companies Hiring

Rundoo Thumbnail
Cloud • Information Technology • Internet of Things • Software
Redwood City, CA
50 Employees
NetBox Labs Thumbnail
Cloud • Software
US
125 Employees
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account