Senior Data Engineering Lead

Posted An Hour Ago
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka
In-Office
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Role
Lead architecture and implementation of enterprise ETL/ELT pipelines, data warehouses, and performance-optimized Spark/Delta Lake workflows on Azure. Collaborate with stakeholders to deliver analytics-ready datasets, enforce data governance and compliance, monitor pipeline health, and mentor junior engineers.
Summary Generated by Built In
Requisition Number: 2338789
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibilities:
  • Architect, design, and implement complex ETL/ELT pipelines using Azure Data Factory, Databricks Azure Function App(Python), and Mongo DB to support large-scale analytics initiatives
  • Lead the development and maintenance of enterprise-grade data models and data warehouses (including star and snowflake schemas) for business intelligence and reporting
  • Optimize performance of distributed data transformations leveraging Spark (Databricks), Delta Lake, partitioning strategies, caching mechanisms, broadcast joins, and resource management
  • Collaborate with business stakeholders - including data scientists and analysts - to deliver robust datasets that enable machine learning modeling & advanced analytics
  • Establish standards for data governance; ensure compliance with organizational security policies as well as regulatory requirements such as GDPR or HIPAA
  • Monitor end-to-end workflow health using Azure Monitor/Log Analytics; proactively troubleshoot issues to maximize system uptime & reliability
  • Mentor junior team members through code reviews, technical leadership sessions, documentation best practices & cross-team knowledge sharing
  • Functions may include database architecture, engineering, design, optimization, security, and administration; as well as data modeling, big data development, Extract, Transform, and Load (ETL) development, storage engineering, data warehousing, data provisioning and other similar roles
  • Responsibilities may include Platform-as-a-Service and Cloud solution with a focus on data stores and associated eco systems
  • Duties may include management of design services, providing sizing and configuration assistance, ensuring strict data quality, and performing needs assessments
  • Analyzes current business practices, processes and procedures as well as identifying future business opportunities for leveraging data storage and retrieval system capabilities
  • Manage relationships with software and hardware vendors to understand the potential architectural impact of different vendor strategies and data acquisition
  • May design schemas, write SQL or other data markup scripting and help to support development of Analytics and Applications that build on top of data
  • Selects, develops and evaluates personnel to ensure the efficient operation of the function
  • Generally, work is self-directed and not prescribed
  • Works with less structured, more complex issues
  • Serves as a resource for others
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regard to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:
  • Undergraduate degree or equivalent experience
  • 10+ years professional experience in enterprise-scale data engineering roles focused on cloud platforms (Azure)
  • Hands-on experience with Mongo DB: schema design/development; query optimization; integration with other cloud platforms
  • Experience implementing robust version control systems (Git) integrated with Databricks/Snowflake workflows
  • Expertise with Azure Data Factory, Databricks notebooks (Python/PySpark/Scala), Synapse Analytics & Data Lake Storage Gen2
  • Advanced proficiency in SQL; solid Python programming skills; experience optimizing Spark workloads at scale
  • Proven ability to architect star/snowflake schema models for large analytical datasets
  • Deep understanding of performance tuning - partitioning strategies, caching layers & broadcast joins - in distributed computing environments

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

Top Skills

Azure Data Factory,Databricks,Databricks Notebooks,Azure Function App (Python),Mongodb,Spark,Delta Lake,Azure Monitor,Log Analytics,Git,Snowflake,Synapse Analytics,Data Lake Storage Gen2,Python,Pyspark,Scala,Sql

What the Team is Saying

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Eden Prairie, MN
160,000 Employees
Year Founded: 2011

What We Do

Optum, part of the UnitedHealth Group family of businesses, is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. At Optum, we support your well-being with an understanding team, extensive benefits and rewarding opportunities. By joining us, you’ll have the resources to drive system transformation while we help you take care of your future. We recognize the power of connection to drive change, improve efficiency and make a difference in health care. Join a team where your skills and ideas can make an impact and where collaboration is key to creating technology that produces healthier outcomes.

Gallery

Gallery
Gallery
Gallery

Optum Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Optum has three workplace models that balance the needs of the business and the responsibilities of each role. These models, core on‑site (5 days/week), hybrid (4 days/week) and telecommute or fully remote, vary by country, role and location.

Typical time on-site: Not Specified
HQEden Prairie, MN
IN
Philippines
Ann Arbor, MI
Atlanta, GA
Baltimore, MD
Belfast, GB
Dallas, TX
Detroit, MI
Hartford, CT
Houston, TX
Jacksonville, FL
Las Vegas, NV
Louisville, KY
Madison, WI
Minneapolis, MN
Nashville, TN
Philadelphia, PA
Phoenix, AZ
Raleigh, NC
San Diego, CA
Washington, DC
Learn more

Similar Jobs

Optum Logo Optum

Senior Data Engineering Lead

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
160000 Employees

Optum Logo Optum

Systems Management Analyst

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
160000 Employees

Optum Logo Optum

Scrum Lead

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
160000 Employees

Optum Logo Optum

Consultant

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
4 Locations
160000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account