Lead Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Pune, Mahārāshtra, IND
In-Office
Expert/Leader
Fintech • Financial Services
The Role
Lead and deliver Azure-based data engineering solutions: design, ingest, transform and operationalize data pipelines using ADF and Databricks, migrate on-prem warehouses to Azure, implement PySpark and Python APIs, build CI/CD with Azure DevOps, tune performance, support Power BI, ensure security/compliance, and lead/mentor a team while engaging stakeholders.
Summary Generated by Built In

About M&G India


We are M&G India, the strategic innovation and digital hub for M&G. Established in 2003, we have offices in Mumbai and Pune.


Our teams work closely with colleagues across the Group worldwide to drive transformation, build digital capability, and support sustainable growth. By leveraging technology, AI, automation, and process excellence, we bring new ways of thinking to improve outcomes for both customers and colleagues.


Grounded in a vibrant culture with strong foundations, we are central to how M&G is transforming as a business.

 

About M&G


Our purpose is to give everyone real confidence to put their money to work. With a heritage dating back more than 175 years, we have a long history of innovation in savings and investments, combining asset management and insurance expertise to offer a wide range of solutions.


Our two distinct operating segments, Asset Management and Life, work together to provide access to balanced, long-term investment and savings solutions.


Through telling it like it is, owning it now, and moving it forward together with care and integrity; we are creating an exceptional place to work for exceptional talent.


                                                                                               

Job Description

Job Title

Lead Data Engineer

Grade

2B

Level

Senior Manager – Data

Job Function

Digital Transformation

Job Sub Function

Azure Data Engineering & DevOps & BI

Reports to

Assistant Vice President – Data Engineering (2A)

Location

Pune

Business Area

M&G Global Services

Overall Job Purpose

At M&G our purpose is to give everyone real confidence to put their money to work. As an international savings and investments business with roots stretching back more than 170 years, we offer a range of financial products and services through Asset Management, Life and Wealth. All three operating segments work together to deliver attractive financial outcomes for our clients, and superior shareholder returns.
Through our behaviours of telling it like it is, owning it now, and moving it forward together with care and integrity; we are creating an exceptional place to work for exceptional talent.

We are looking to expand the in-house expertise in Data Technology and we need talented and skilled colleagues to implement data engineering solutions using latest technologies available in Azure Cloud space conforming to the best in class design standard & agreed requirements

Accountabilities/Responsibilities

  • Lead data engineering projects to build and operationalize data solutions for business using Azure services in combination with custom solutions – Azure Data Factory, Azure Data Flows, Azure Databricks, Azure Data Lake Gen 2, Azure SQL etc
  • Proven experience on leading a team of data engineers providing technical guidance and ensuring alignment with agreed architectural principles
  • Experience in migrating on-premise data warehouses to data platforms on AZURE cloud
  • Designing and implementing data engineering, ingestion and transformation functions using ADF, Databricks
  • Proficient in Py-Spark
  • Experience in building Python based APIs on Azure Function Apps
  • Experience on Azure Logic apps
  • Experience in Lakehouse/Datawarehouse implementation using modern data platform architecture
  • Capacity Planning and Performance Tuning on ADF & Databricks pipelines
  • Support data visualization development using Power BI
  • Exposure across all the SDLC process, including testing and deployment
  • Experience in relational and dimensional modelling, including big data technologies
  • Experience in Azure DevOps – Build CI/CD pipelines for ADF, ADLS, Databricks, Azure SQL  DB etc
  • Experience of working in secured Azure environments using Azure KeyVaults, Service Principals, and Managed Identities
  • Good to have knowledge on Apigee (Googles API Management)
  • Understanding of data masking, encryption and other practices used in handling sensitive data
  • Ability to interact with Business for requirement gathering and query resolutions
  • Working on off shore office based development teams, collaborating within a team environment and participating in typical project lifecycle activities such as requirement analysis, testing and release
  • Develop Azure Data skills within the team through knowledge sharing sessions, articles, etc.
  • Adherence to organisations Risk & Controls requirements
  • Should have skills for Stakeholder management, process adherence, planning & documentationss

Key Stakeholder Management

Internal

Business Teams

Project Manager

Architects

Data Scientists

Team members

External

Knowledge, Skills, Experience & Educational Qualification

Knowledge & Skills:

  • Azure Data Factory,
  • Azure Data Lake Storage V2
  • Azure SQL
  • Azure DataBricks
  • Pyspark
  • Azure DevOps
  • Power BI Report
  • Technical leadership
  • Confidence & excellent communication

Experience:

  • Overall 12+  years of experience
  • 5 + Experience on Azure data engineering
  • 5 + experience of managing data deliveries

Educational Qualification:

  • Graduate/Post-graduate. Preferably with specialisation in Computer Science, Statistics, Mathematics, Data Science, Engineering or related discipline

Microsoft Azure certification (good to have)


We have a diverse workforce and an inclusive culture at M&G Global Services, regardless of gender, ethnicity, age, sexual orientation, nationality, disability or long term condition, we are looking to attract, promote and retain exceptional people. We also welcome those who take part in military service and those returning from career breaks.

Skills Required

  • Lead data engineering projects using Azure services (ADF, Data Flows, Databricks, ADLS Gen2, Azure SQL)
  • Proven experience leading a team of data engineers and providing technical guidance
  • Experience migrating on-premise data warehouses to Azure data platforms
  • Designing and implementing data ingestion and transformation using Azure Data Factory and Databricks
  • Proficiency in PySpark
  • Experience building Python-based APIs on Azure Function Apps
  • Experience with Azure Logic Apps
  • Experience implementing Lakehouse/Datawarehouse using modern data platform architecture
  • Capacity planning and performance tuning for ADF and Databricks pipelines
  • Support data visualization development using Power BI
  • Exposure to full SDLC including testing and deployment
  • Experience in relational and dimensional modelling and big data technologies
  • Experience with Azure DevOps to build CI/CD pipelines for ADF, ADLS, Databricks, and Azure SQL
  • Experience working in secured Azure environments using Azure Key Vault, Service Principals, and Managed Identities
  • Understanding of data masking, encryption and practices for handling sensitive data
  • Ability to interact with business stakeholders for requirements and query resolution
  • Overall 12+ years of experience with 5+ years in Azure data engineering and 5+ years managing data deliveries
  • Graduate or post-graduate in Computer Science, Statistics, Mathematics, Data Science, Engineering or related discipline
  • Microsoft Azure certification
  • Knowledge of Apigee (Google API Management)

M&G Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about M&G and has not been reviewed or approved by M&G.

  • Retirement Support Pension support in the UK is presented as notably generous versus typical market norms and is positioned as a core part of total reward. Formal materials also highlight share plans and financial‑wellbeing tools alongside pension value.
  • Leave & Time Off Breadth Annual leave in the UK is described as substantially above statutory norms with the option to purchase additional days. Additional flexibility is referenced through policies such as “Time Off When You Need It.”
  • Parental & Family Support Parental policies (e.g., “Inspiring Families”) are characterized as extensive, including long fully paid leave and phased return‑to‑work support. External recognition is cited as reinforcing family support as a distinctive element of the package.

M&G Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
2,729 Employees

What We Do

M&G plc is a leading international savings and investments business, managing money for around 4.6 million individual clients and more than 900 institutional clients in 38 offices worldwide. As at 31 December 2023, we had £343.5 billion of assets under management and administration. Our purpose is to give everyone real confidence to put their money to work. With a heritage dating back more than 175 years, M&G plc has a long history of innovation in savings and investments, combining asset management and insurance expertise to offer a wide range of solutions. Our three distinct operating segments, Asset Management, Life and Wealth, work together to provide access to balanced, long-term investment and savings solutions.

Similar Jobs

Mastercard Logo Mastercard

Lead Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Mahārāshtra, IND
38800 Employees

Mastercard Logo Mastercard

Lead Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Mahārāshtra, IND
38800 Employees

Weekday, Inc. Logo Weekday, Inc.

Lead Data Engineer

Artificial Intelligence • HR Tech • Professional Services • Software
In-Office
4 Locations
1M-3M Annually

Weekday, Inc. Logo Weekday, Inc.

Lead Data Engineer

Artificial Intelligence • HR Tech • Professional Services • Software
In-Office
4 Locations
2M-3M Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account