The Role
Lead the design and implementation of resilient batch, micro-batch, and event-driven healthcare data pipelines on AWS and Databricks. Build ingestion frameworks, Spark/PySpark transformations, Delta Lake and Iceberg tables, healthcare data models, quality and lineage frameworks, and privacy-aware PHI processing. Deliver CI/CD, infrastructure automation, testing, observability, monitoring, and incident recovery. Optimize governed data consumption while ensuring compliance with healthcare and regulated-data requirements.
Summary Generated by Built In
Requisition Number: 2384847
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibilities:
Eligibility
To apply to an internal job, employees must meet the following criteria:
Required Qualifications:
Required Qualifications:
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibilities:
- Build reliable batch, micro-batch, and event-driven pipelines on AWS and Databricks
- Develop reusable ingestion frameworks for REST APIs, FHIR Bulk Export, HL7 interfaces, databases, SFTP/file exchange, JSON/NDJSON, CSV, XML, PDFs, and clinical text
- Implement scalable Spark/PySpark and SQL transformations, including schema inference/evolution, checkpointing, idempotency, retries, backfills, and replay
- Design and maintain Delta Lake and Apache Iceberg tables, including physical design, partitioning/clustering, compaction, file sizing, incremental reads/writes, performance tuning, and cost optimization
- Build curated healthcare data models and transformations using FHIR, HL7, OMOP CDM, and clinical terminology mappings
- Implement data-quality frameworks: schema validation, referential-integrity checks, business-rule testing, anomaly detection, reconciliation, completeness checks, and data-quality observability
- Build metadata and lineage capture across source systems, pipeline runs, code versions, transformation rules, mappings, and published data products
- Implement privacy-aware data processing for PHI, including access controls, masking, tokenization/pseudonymization, de-identification, and auditable handling patterns
- Deliver CI/CD pipelines, automated unit/integration/data tests, Terraform or CloudFormation, containerized services, monitoring, alerting, runbooks, and incident-recovery procedures
- Integrate and optimize governed data consumption through Databricks SQL, Athena, Snowflake, Trino, or equivalent engines
- Comply with all applicable Company policies, procedures, and business directives, changes including those relating to work location, team assignments, work schedules, and flexible work arrangements
Eligibility
To apply to an internal job, employees must meet the following criteria:
- The candidate should have completed 12 months in the current role
- The candidate should not be on any active CAP/ PIP
- The performance review of the candidate must be ME & Above in the last common review
Required Qualifications:
- Graduate degree or equivalent experience
- 5+ years of production data-engineering experience
- Hands-on AWS experience with S3, IAM, VPC, ECS/EKS or Lambda, Step Functions, EventBridge, CloudWatch, Secrets Manager, and KMS
- Experience with Git, pull requests, CI/CD, Docker, Terraform/CloudFormation, automated testing, observability, and incident response
- Experience processing semi-structured data and building resilient ingestion pipelines with quality controls, error handling, and replay capability
- Production Databricks experience with Auto Loader, Delta Lake, Workflows, Unity Catalog, notebooks/jobs, SQL Warehouses, and cluster/job optimization
- Advanced Python, SQL, and Apache Spark/PySpark; strong understanding of distributed processing and performance tuning
- Practical Apache Iceberg knowledge, including tables, catalogs, snapshots, schema/partition evolution, compaction, and interoperability with query engines
- Healthcare data knowledge: FHIR R4 and/or HL7 v2, OMOP CDM, clinical terminologies, PHI, HIPAA-aligned engineering controls, and de-identification concepts
- Demonstrated responsible use of AI coding tools and the ability to critically review, test, and productionize generated code
Required Qualifications:
- Healthcare or regulated-data experience
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
Skills Required
- Graduate degree or equivalent experience
- 5+ years of production data-engineering experience
- Hands-on AWS experience with S3, IAM, VPC, ECS/EKS or Lambda, Step Functions, EventBridge, CloudWatch, Secrets Manager, and KMS
- Experience with Git, pull requests, CI/CD, Docker, Terraform or CloudFormation, automated testing, observability, and incident response
- Experience processing semi-structured data and building resilient ingestion pipelines with quality controls, error handling, and replay capability
- Production Databricks experience with Auto Loader, Delta Lake, Workflows, Unity Catalog, notebooks/jobs, SQL Warehouses, and cluster/job optimization
- Advanced Python, SQL, and Apache Spark/PySpark skills, including distributed processing and performance tuning
- Practical Apache Iceberg knowledge, including tables, catalogs, snapshots, schema and partition evolution, compaction, and query-engine interoperability
- Healthcare data knowledge including FHIR R4 or HL7 v2, OMOP CDM, clinical terminologies, PHI, HIPAA-aligned engineering controls, and de-identification concepts
- Demonstrated responsible use of AI coding tools and ability to critically review, test, and productionize generated code
- Healthcare or regulated-data experience
- Completion of 12 months in the current role for internal applicants
- No active CAP or PIP for internal applicants
- Performance review rating of ME or above in the last common review for internal applicants
Optum Compensation & Benefits Highlights
-
Parental & Family Support — Paid parental leave (six weeks), paid caregiver leave (up to two weeks), Bright Horizons back-up care, and adoption assistance up to $10,000 are prominently included. Feedback suggests these family supports meaningfully aid work-life balance and are often highlighted as strengths.
-
Retirement Support — A 401(k) with company match is available to all employees, including part-time staff, alongside other financial protections like disability and life insurance. Feedback suggests broad access and matching make retirement support a core pillar of the package.
-
Equity Value & Accessibility — An Employee Stock Purchase Plan offers discounted company stock, with some roles also eligible for sign-on or performance bonuses. Feedback suggests the ESPP is a standout financial perk that helps employees build ownership over time.
Optum Insights
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Optum, part of the UnitedHealth Group family of businesses, is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. At Optum, we support your well-being with an understanding team, extensive benefits and rewarding opportunities. By joining us, you’ll have the resources to drive system transformation while we help you take care of your future. We recognize the power of connection to drive change, improve efficiency and make a difference in health care. Join a team where your skills and ideas can make an impact and where collaboration is key to creating technology that produces healthier outcomes.
Gallery
.jpg)
Optum Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
Optum has three workplace models that balance the needs of the business and the responsibilities of each role. These models, core on‑site (5 days/week), hybrid (4 days/week) and telecommute or fully remote, vary by country, role and location.
Typical time on-site:
Not Specified
