Associate Data Engineering Manager

Posted 7 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Role
The role involves designing and building scalable data pipelines, ensuring data quality, and collaborating with analytics teams to translate requirements into production data assets.
Summary Generated by Built In
Requisition Number: 2342937
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
The EL3 Databricks Data Engineer will design, build, and optimize scalable data pipelines supporting Claims Payment Integrity (PI) analytics across Medicare and Retirement, Community and States, and Employer and Individual businesses. The role focuses on developing governed lakehouse-based data assets, integrating claims and provider datasets, and ensuring high-quality data availability for PI, actuarial, audit, recovery, and financial analytics teams.
Primary Responsibilities:
  • Data Engineering and Lakehouse Development
    • Build scalable ETL/ELT pipelines in Databricks using PySpark, Spark SQL, Delta Live Tables, and workflows
    • Engineer curated datasets across bronze/silver/gold layers for claims, pricing, provider, RCM, and member data
    • Implement Delta Lake best practices including ACID transactions, schema evolution, CDC, and optimized storage formats
    • Automate ingestion/transformation of large datasets from claims systems, provider files, call center platforms, and EHR feeds
  • Data Quality and Governance
    • Perform reconciliation and validation of claim-related financial datasets
    • Enforce PHI-compliant design patterns using Unity Catalog, governance guardrails, and cluster policies
    • Implement pipeline monitoring, logging, and Spark performance optimization
  • Platform and Collaboration
    • Work with Data Analysts, Data Scientists, and PI SMEs to translate analytic requirements into production data assets
    • Support cluster optimization, table indexing (Z-ORDER), and cost-efficient lakehouse operations
    • Participate in Agile ceremonies and ensure timely delivery of engineering tasks
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:
  • Bachelor's degree (4-year)
  • 8+ years of Data Engineering experience in healthcare
  • Technical Skills
  • Hands-on experience with Databricks (PySpark, SQL, Delta Lake, Jobs/Workflows)
  • Solid Spark performance tuning experience
  • Experience engineering data for claims, provider, and membership domains
  • Solid understanding of healthcare data models and adjudication flows

Preferred Qualifications:
  • Experience with Call center data (member & provider interactions), Provider RCM datasets, and EHR/clinical data
  • Experience with DLT, CI/CD, and MLflow-integrated pipelines
  • Exposure to actuarial or PI forecasting workflows

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

Skills Required

  • Bachelor's degree (4-year)
  • 8+ years of Data Engineering experience in healthcare
  • Hands-on experience with Databricks (PySpark, SQL, Delta Lake, Jobs/Workflows)
  • Solid Spark performance tuning experience
  • Experience engineering data for claims, provider, and membership domains
  • Solid understanding of healthcare data models and adjudication flows

What the Team is Saying

Optum Compensation & Benefits Highlights

  • Healthcare Strength Health coverage offers multiple plan types with employer HSA contributions, in‑network preventive care at 100%, and included 24/7 virtual visits, alongside dental and vision options. This breadth allows predictable copay choices or tax‑advantaged HSA designs to fit different usage needs.
  • Retirement Support Retirement programs include a 401(k) with employer match eligibility and full vesting over time plus an Employee Stock Purchase Plan at a discount. Together these elements support long‑term savings and ownership.
  • Parental & Family Support Family supports include six weeks paid parental leave, paid caregiver leave, adoption assistance, and subsidized Bright Horizons back‑up care. Emotional well‑being resources like a premium Calm subscription and a 24/7 EAP complement these supports.

Optum Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Eden Prairie, MN
160,000 Employees
Year Founded: 2011

What We Do

Optum, part of the UnitedHealth Group family of businesses, is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. At Optum, we support your well-being with an understanding team, extensive benefits and rewarding opportunities. By joining us, you’ll have the resources to drive system transformation while we help you take care of your future. We recognize the power of connection to drive change, improve efficiency and make a difference in health care. Join a team where your skills and ideas can make an impact and where collaboration is key to creating technology that produces healthier outcomes.

Gallery

Gallery
Gallery
Gallery

Optum Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Optum has three workplace models that balance the needs of the business and the responsibilities of each role. These models, core on‑site (5 days/week), hybrid (4 days/week) and telecommute or fully remote, vary by country, role and location.

Typical time on-site: Not Specified
HQEden Prairie, MN
Philippines
Ann Arbor, MI
Atlanta, GA
Baltimore, MD
Belfast, GB
Bengaluru, India
Chennai, India
Dallas, TX
Detroit, MI
Hartford, CT
Houston, TX
Hyderabad, India
Jacksonville, FL
Las Vegas, NV
Louisville, KY
Madison, WI
Minneapolis, MN
Nashville, TN
New Delhi, India
Philadelphia, PA
Phoenix, AZ
Pune, India
Raleigh, NC
San Diego, CA
Washington, DC
Learn more

Similar Jobs

Optum Logo Optum

Data Engineering Manager

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
160000 Employees

Optum Logo Optum

Data Engineering Manager

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
160000 Employees

Optum Logo Optum

Lead Data Scientist

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
160000 Employees

Optum Logo Optum

Consultant

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
160000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account