Senior Big Data Engineer - I

Posted 2 Days Ago
Be an Early Applicant
Pune, Maharashtra, IND
Hybrid
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
At MetLife, we’re a purpose-driven company that helps our customers build a more confident future.
The Role
Designs and delivers scalable data engineering solutions across Azure and on-premises environments. Builds batch and real-time ETL/ELT pipelines, data lakes, warehouses, marts, and streaming platforms using Spark and related Big Data technologies. Leads architecture, technical design, optimization, governance, and end-to-end implementation while ensuring quality, security, reliability, and performance. Collaborates with cross-functional stakeholders, mentors data engineers, and communicates technical recommendations to business and technology audiences.
Summary Generated by Built In
Description and Requirements
Data Engineer
The Opportunity
The Data Engineer is responsible for designing, building, and delivering scalable data engineering solutions that enable advanced analytics, reporting, and business decision-making across the organization. This role plays a critical part in the data and analytics lifecycle by developing production-grade data platforms and pipelines leveraging Big Data technologies and cloud-based solutions.
As a senior individual contributor, this position is expected to independently solve complex business challenges, lead solution design and estimation activities, and drive engineering excellence across projects. The role provides an exciting opportunity to work with modern Azure data technologies, large-scale distributed systems, and real-time data processing frameworks while mentoring data engineers and collaborating with stakeholders across Business, Technology, Operations, and Data & Analytics functions.
Key Responsibilities
  • Design, build, and maintain robust ETL/ELT pipelines across Azure cloud and on-premises environments for batch and real-time data processing.
  • Develop scalable solutions to collect, ingest, transform, and store large volumes of structured and unstructured data.
  • Independently lead solution architecture, technical design, effort estimation, and implementation planning for data engineering initiatives.
  • Monitor, optimize, and troubleshoot data platforms and pipelines to ensure reliability, scalability, availability, and performance.
  • Implement and enforce data quality, governance, security, compliance, and operational standards.
  • Build and support data lakes, data warehouses, data marts, and Medallion Architecture-based solutions.
  • Develop real-time and streaming data pipelines using Apache Spark and related technologies.
  • Collaborate with cross-functional teams including Data Governance, Data Quality, Data Architecture, Data Modeling, Data Science, DevOps, Business Intelligence, Operations, and Technology groups.
  • Mentor and guide Data Engineers through technical leadership, knowledge sharing, and best practice adoption.
  • Drive stakeholder engagement, provide technical recommendations, and effectively communicate complex technical solutions to business and technology audiences.

Required Qualifications
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or an equivalent educational qualification.
  • 8-10+ years of experience in Data Engineering, Big Data, Cloud Data Platforms, or related domains.
  • Strong expertise in SQL and Python and/or Scala for large-scale data processing and engineering solutions.
  • Extensive experience in ETL/ELT pipeline design, development, solution architecture, and estimation.
  • Hands-on experience with Big Data technologies including Apache Spark, Hadoop, and Hive.
  • Strong proficiency in Azure Data Engineering services including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Event Hub, and Azure Functions.
  • Experience working with NoSQL and distributed databases such as Cosmos DB and HBase.
  • Deep understanding of Data Lakes, Data Warehouses, Data Marts, and Medallion Architecture.
  • Strong expertise in performance optimization, scalability improvements, and data quality validation.
  • Experience designing and supporting both batch and real-time streaming data pipelines using Spark.
  • Excellent communication, analytical thinking, structured problem-solving, storytelling, and stakeholder management skills.
  • Proven experience mentoring and developing junior and mid-level Data Engineers.
  • Ability to work independently and drive end-to-end solution delivery in a senior individual contributor capacity.

Preferred Qualifications
  • Experience with DevOps practices including Git, Azure DevOps, and CI/CD pipeline implementation.
  • Knowledge of Kafka, MongoDB, Apache NiFi, and Unix Shell Scripting.
  • Exposure to Generative AI technologies, AI-enabled data platforms, and emerging AI tools.
  • Experience working within the Banking, Financial Services, and Insurance (BFSI) domain.
  • Azure certifications in Data Engineering, Cloud Architecture, or related technologies.
  • Experience leading cloud modernization, data transformation, and enterprise-scale analytics initiatives.
  • Strong consulting mindset with the ability to influence technical and business stakeholders.

Experience
8-10+ Years of Relevant Experience
Education
Bachelor's Degree in Computer Science, Information Technology, Engineering, or Equivalent Educational Qualification.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid

Skills Required

  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or equivalent educational qualification
  • 8-10+ years of experience in Data Engineering, Big Data, Cloud Data Platforms, or related domains
  • Strong expertise in SQL and Python and/or Scala for large-scale data processing and engineering solutions
  • Extensive experience in ETL/ELT pipeline design, development, solution architecture, and estimation
  • Hands-on experience with Apache Spark, Hadoop, and Hive
  • Strong proficiency in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Event Hub, and Azure Functions
  • Experience with NoSQL and distributed databases such as Cosmos DB and HBase
  • Deep understanding of Data Lakes, Data Warehouses, Data Marts, and Medallion Architecture
  • Strong expertise in performance optimization, scalability improvements, and data quality validation
  • Experience designing and supporting batch and real-time streaming data pipelines using Spark
  • Excellent communication, analytical thinking, structured problem-solving, storytelling, and stakeholder management skills
  • Proven experience mentoring and developing junior and mid-level Data Engineers
  • Ability to work independently and drive end-to-end solution delivery in a senior individual contributor capacity
  • Experience with Git, Azure DevOps, and CI/CD pipeline implementation
  • Knowledge of Kafka, MongoDB, Apache NiFi, and Unix Shell Scripting
  • Exposure to Generative AI technologies, AI-enabled data platforms, and emerging AI tools
  • Experience working within the Banking, Financial Services, and Insurance domain
  • Azure certifications in Data Engineering, Cloud Architecture, or related technologies
  • Experience leading cloud modernization, data transformation, and enterprise-scale analytics initiatives
  • Strong consulting mindset with the ability to influence technical and business stakeholders

What the Team is Saying

Chelsea
Nick
Naren
Laura
Bill
Jing Huang
Sara Strauch
Dan Xiao
Cara Mootz
Cara Mootz
Naren Peri
Patricia Hixson
Jing Huang
Samantha Heron
Pete Clarke
Erica Provido
Rene Rivera

MetLife Compensation & Benefits Highlights

  • Healthcare Strength — Health coverage is frequently described as robust, spanning medical, dental, vision, prescription benefits, and targeted programs for chronic or complex conditions. Feedback suggests access to multiple plan types, wellness resources, and expert second opinions strengthens the overall package.
  • Retirement Support — The combination of a 401(k) match and a company-funded pension is considered a standout element of total compensation. Feedback suggests this long-term security materially boosts perceived value beyond base salary alone.
  • Parental & Family Support — Paid parental leave, caregiving resources, and backup child and elder care are highlighted alongside family-building and fertility support. Feedback suggests these programs meaningfully complement standard benefits to support work-life needs.

MetLife Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
43,000 Employees
Year Founded: 1868

What We Do

We're honored to be No. 10 on Great Place to Work's World's Best Workplaces and recognized in the Fortune 100 Best Companies to Work For® list in 2025. At MetLife, we're leading the global transformation of an industry we’ve defined for over 157 years. At MetLife, every innovation and line of code is a lifeline for our customers and their families—from victims of natural disasters to people living with disabilities and beyond. With operations in more than 40 markets and leading positions across the globe, MetLife fosters an inclusive culture where our people are energized and inspired to deliver for our customers and communities. Join our remarkable journey—one in which you help write the next century of innovation in financial services—because with MetLife, making the world a better place is All Together Possible.

Why Work With Us

At MetLife, you’ll be working for a company whose purpose is to help customers throughout their life’s journey, and often in their most critical time of need. You’ll be a part of developing leading-edge platforms that will have a lasting impact on the lives and well-being of tens of millions of customers.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

MetLife Teams

Team
Product + Tech
About our Teams

MetLife Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

MetLife's current workplace policies classify roles as Office, Hybrid or Virtual based on the nature of work, encouraging new ways of working together

Typical time on-site: Flexible
Company Office Image
HQNew York City, NY
Company Office Image
Pune, IN
Company Office Image
Mexico City, MX
Company Office Image
Bridgewater, NJ
Company Office Image
Cary, NC
Company Office Image
Clark Summit, PA
Company Office Image
Greenville, SC
Company Office Image
Hyderabad, IN
Company Office Image
Tampa, FL
Tokyo, JP
Company Office Image
Whippany, NJ
Learn more

Similar Jobs

MetLife Logo MetLife

Platform Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Pune, Maharashtra, IND
43000 Employees

MetLife Logo MetLife

Data Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Pune, Maharashtra, IND
43000 Employees

MetLife Logo MetLife

Senior Data Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Pune, Maharashtra, IND
43000 Employees

MetLife Logo MetLife

Oracle HCM and Analytics Techno-Functional Analyst

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Pune, Maharashtra, IND
43000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account