MetLife Jobs

Lead Big Data Engineer

MetLife

Lead Big Data Engineer

Posted 6 Days Ago

Be an Early Applicant

Pune, Maharashtra, IND

Hybrid

Expert/Leader

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics

At MetLife, we’re a purpose-driven company that helps our customers build a more confident future.

The Role

Leads the design, development, and maintenance of enterprise-scale batch and real-time data pipelines across Azure and on-premises environments. Builds scalable ingestion and processing frameworks, optimizes reliability and performance, and ensures data quality, governance, security, and compliance. Provides solution architecture, technical leadership, stakeholder collaboration, mentoring, and engineering standards adoption across complex programs.

Summary Generated by Built In

Description and Requirements
Data Engineer
The Opportunity
As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data solutions that support enterprise-wide analytics and business intelligence initiatives. The role requires deep expertise in Big Data technologies, cloud platforms, and modern data engineering practices. In addition to technical leadership, you will play a key role in mentoring and developing Data & Analytics talent while driving delivery excellence across complex programs.
Key Responsibilities

Design, develop, and maintain robust ETL/ELT pipelines on Azure cloud and on-premises platforms for batch and real-time data processing.
Build scalable data ingestion and processing frameworks to handle structured, semi-structured, and unstructured datasets.
Solve complex business problems by leveraging data engineering best practices and advanced technologies.
Monitor, optimize, and troubleshoot data pipelines to ensure high availability, reliability, performance, and scalability.
Ensure adherence to data quality, governance, security, privacy, and compliance standards.
Collaborate with business stakeholders, architects, data scientists, governance teams, DevOps teams, and analytics partners to deliver business value.
Lead solution design discussions, technical estimations, architecture reviews, and implementation strategies.
Provide technical guidance and mentorship to engineering teams while fostering continuous learning and capability development.
Drive adoption of engineering standards, reusable frameworks, and best practices across programs.

Primary Requirements
A. Technical Skills

Strong experience with SQL, Python, and/or Scala.
Hands-on expertise in Big Data technologies including Apache Spark, Hadoop, and Hive.
Experience designing and developing enterprise-scale ETL/ELT pipelines.
Expertise in Azure Data Engineering ecosystem:
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Azure Databricks
- Azure Event Hub
- Azure Functions
Experience with NoSQL and Distributed Databases such as Cosmos DB and HBase.
Strong understanding of Data Warehouses, Data Lakes, and Data Marts.
Experience implementing Medallion Architecture and modern data design patterns.
Expertise in data performance tuning, optimization, and quality validation.
Experience building both real-time and batch processing pipelines, including Spark Streaming.

B. Additional Requirements

Excellent communication and stakeholder management skills.
Strong analytical and structured problem-solving capabilities.
Proven experience in solution architecture, estimation, and technical leadership.
Ability to effectively communicate technical concepts through storytelling and presentations.
Experience managing relationships with business partners and senior stakeholders.
Demonstrated people leadership experience, including coaching, mentoring, talent development, and engagement.

Good to Have

Experience with DevOps and CI/CD practices using Git and Azure DevOps.
Unix/Linux shell scripting expertise.
Experience with MongoDB and Apache NiFi.
Understanding of Lambda and Kappa architecture patterns.
Exposure to Generative AI technologies, tools, and use cases.
Banking, Financial Services, and Insurance (BFSI) domain experience.

Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or equivalent educational qualification.
12-14+ years of relevant experience in Data Engineering, Big Data, and Cloud technologies.

About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid

Skills Required

Bachelor’s degree in Computer Science, Information Technology, Engineering, or equivalent education
12–14+ years of relevant experience in data engineering, Big Data, and cloud technologies
Strong experience with SQL, Python, and/or Scala
Hands-on experience with Apache Spark, Hadoop, and Hive
Experience designing and developing enterprise-scale ETL/ELT pipelines
Expertise with Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure Event Hubs, and Azure Functions
Experience with Cosmos DB and HBase
Understanding of data warehouses, data lakes, and data marts
Experience implementing Medallion Architecture and modern data design patterns
Experience with data performance tuning, optimization, and quality validation
Experience building real-time and batch processing pipelines, including Spark Streaming
Excellent communication, stakeholder management, analytical, and structured problem-solving skills
Experience in solution architecture, estimation, and technical leadership
People leadership experience, including coaching, mentoring, talent development, and engagement
Experience with DevOps and CI/CD using Git and Azure DevOps
Unix/Linux shell scripting expertise
Experience with MongoDB and Apache NiFi
Understanding of Lambda and Kappa architecture patterns
Exposure to Generative AI technologies, tools, and use cases
Banking, Financial Services, and Insurance domain experience

What the Team is Saying

MetLife Compensation & Benefits Highlights

Healthcare Strength — Health coverage is frequently described as robust, spanning medical, dental, vision, prescription benefits, and targeted programs for chronic or complex conditions. Feedback suggests access to multiple plan types, wellness resources, and expert second opinions strengthens the overall package.
Retirement Support — The combination of a 401(k) match and a company-funded pension is considered a standout element of total compensation. Feedback suggests this long-term security materially boosts perceived value beyond base salary alone.
Parental & Family Support — Paid parental leave, caregiving resources, and backup child and elder care are highlighted alongside family-building and fertility support. Feedback suggests these programs meaningfully complement standard benefits to support work-life needs.

Learn more about MetLife's Compensation & Benefits →

MetLife Insights

What's It Like to Work at MetLife? MetLife Culture & Values MetLife Career Growth & Development What's the Work-Life Balance Like at MetLife? MetLife Leadership & Management MetLife Company Growth, Stability & Outlook

View all jobs at MetLife

View MetLife Profile

Report Job

Am I A Good Fit?

beta

Get Personalized Job Insights.

Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

HQ: New York, NY

43,000 Employees

Year Founded: 1868

What We Do

We're honored to be No. 10 on Great Place to Work's World's Best Workplaces and recognized in the Fortune 100 Best Companies to Work For® list in 2025. At MetLife, we're leading the global transformation of an industry we’ve defined for over 157 years. At MetLife, every innovation and line of code is a lifeline for our customers and their families—from victims of natural disasters to people living with disabilities and beyond. With operations in more than 40 markets and leading positions across the globe, MetLife fosters an inclusive culture where our people are energized and inspired to deliver for our customers and communities. Join our remarkable journey—one in which you help write the next century of innovation in financial services—because with MetLife, making the world a better place is All Together Possible.

Why Work With Us

At MetLife, you’ll be working for a company whose purpose is to help customers throughout their life’s journey, and often in their most critical time of need. You’ll be a part of developing leading-edge platforms that will have a lasting impact on the lives and well-being of tens of millions of customers.

Gallery

MetLife Teams

Learn More

Product + Tech

About our Teams

MetLife Offices

Learn More

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

MetLife's current workplace policies classify roles as Office, Hybrid or Virtual based on the nature of work, encouraging new ways of working together

Typical time on-site: Flexible