Sr Data Engineer

Posted Yesterday
Be an Early Applicant
Eden Prairie, MN, USA
In-Office
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Role
Designs and develops scalable Azure and Databricks data pipelines using Python, PySpark, Spark, Delta Lake, ADF, and ADLS. Partners with AI and Data Science teams to operationalize machine learning models, feature stores, and streaming analytics. Builds reusable automation frameworks, ensures data quality, governance, security, and compliance, and optimizes batch and streaming workflows. Participates in Agile delivery, CI/CD, code reviews, production support, and responsible AI implementation.
Summary Generated by Built In
Requisition Number: 2388907
Our Company
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, and data they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits, and career development opportunities. Come make an impact on the communities we serve as you help us advance health equity on a global scale. Join us to start Caring. Connecting. Growing together.
Position Summary
As a Senior Data Engineer on the (Input Required) team at Optum Technology, you will lead the design and development of scalable, cloud-native data pipelines and machine learning data architectures on Azure and Databricks. In this role, you will build data integration routines using PySpark, Delta Lake, and Azure Data Factory, while collaborating with Data Science and AI teams to operationalize ML models, feature stores, and streaming analytics frameworks. You will leverage enterprise-approved AI tools to automate workflows, establish reusable engineering accelerators, and ensure data quality, security, and responsible AI implementation across high-volume healthcare data ecosystems.
You'll enjoy the flexibility to telecommute* from anywhere within the U.S. as you take on some tough challenges.
Primary Responsibilities
  • Design and develop scalable ETL/ELT data pipelines using Databricks, Apache Spark, and Python on Azure cloud platforms
  • Build cloud-native data solutions leveraging Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and Delta Lake architecture
  • Collaborate with Data Science and AI teams to operationalize machine learning models, feature stores, model input pipelines, and real-time/streaming frameworks
  • Design, develop, and deploy AI-powered solutions to address complex business challenges with an emphasis on responsible use of AI
  • Build reusable frameworks, engineering accelerators, and automation scripts to improve engineering efficiency and delivery quality
  • Ensure data quality, governance, security, and compliance across the complete data lifecycle
  • Optimize the performance, scalability, and cost-efficiency of batch and streaming data workflows, including Databricks Delta Live Tables (DLT)
  • Participate in Agile development practices (sprint planning, code reviews, CI/CD automation with GitHub Actions or Azure DevOps), and provide production support/on-call coverage to ensure system stability
  • Leverage enterprise-approved AI tools to streamline software engineering workflows, automate tasks, and drive continuous operational improvement
  • Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI

You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.
Required Qualifications
  • 4+ years of experience in Data Engineering developing with Python and PySpark
  • 4+ years of experience building scalable ETL/ELT data pipelines using Databricks
  • 4+ years of experience working within Agile/Scrum project environments
  • 4+ years of hands-on experience with Azure Databricks and Delta Lake architecture
  • 4+ years of experience implementing CI/CD pipelines using GitHub Actions or Azure DevOps
  • 3+ years of hands-on experience with Azure cloud services, including Azure Data Factory (ADF) or Azure Data Lake Storage (ADLS)
  • 2+ years of experience with unit testing, data validation, and pipeline testing frameworks

Preferred Qualifications
  • Bachelor's or higher degree in Computer Science, Engineering, Information Technology, or a related field
  • Experience building, operationalizing, or deploying machine learning models, feature stores, and AI-powered data pipelines
  • Experience with real-time and streaming analytics frameworks (e.g., Spark Structured Streaming, Event Hubs, Kafka)
  • Knowledge of enterprise data governance, security masking, access control policies, and data quality frameworks
  • Experience building reusable automation frameworks, Docker containers, or Kubernetes orchestration workflows
  • Strong self-starter with a proven track record of managing technical deliverables independently and taking end-to-end ownership
  • 4+ years of experience writing complex SQL / PL-SQL queries and data transformations
  • 2+ years of experience working with Databricks Delta Live Tables (DLT)

*All Telecommuters will be required to adhere to UnitedHealth Group's Telecommuter Policy.
Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $91,700 to $163,700 annually based on full-time employment. We comply with all minimum wage laws as applicable.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Application Deadline: This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected. Job posting may come down early due to volume of applicants.
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location, and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups, and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
Diversity creates a healthier atmosphere: UnitedHealth Group is an Equal Employment Opportunity/Affirmative Action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status, sexual orientation, gender identity or expression, marital status, genetic information, or any other characteristic protected by law.
UnitedHealth Group is a drug-free workplace. Candidates are required to pass a drug test before beginning employment.
#RPO, #GREEN

Skills Required

  • 4+ years of data engineering experience developing with Python and PySpark
  • 4+ years of experience building scalable ETL/ELT data pipelines using Databricks
  • 4+ years of experience working within Agile/Scrum project environments
  • 4+ years of hands-on experience with Azure Databricks and Delta Lake architecture
  • 4+ years of experience implementing CI/CD pipelines using GitHub Actions or Azure DevOps
  • 3+ years of hands-on experience with Azure cloud services, including Azure Data Factory or Azure Data Lake Storage
  • 2+ years of experience with unit testing, data validation, and pipeline testing frameworks
  • Bachelor's or higher degree in Computer Science, Engineering, Information Technology, or a related field
  • Experience building, operationalizing, or deploying machine learning models, feature stores, and AI-powered data pipelines
  • Experience with real-time and streaming analytics frameworks such as Spark Structured Streaming, Event Hubs, or Kafka
  • Knowledge of enterprise data governance, security masking, access control policies, and data quality frameworks
  • Experience building reusable automation frameworks, Docker containers, or Kubernetes orchestration workflows
  • Strong self-starter with a proven record of independently managing technical deliverables and taking end-to-end ownership
  • 4+ years of experience writing complex SQL or PL/SQL queries and data transformations
  • 2+ years of experience working with Databricks Delta Live Tables

What the Team is Saying

Optum Compensation & Benefits Highlights

  • Leave & Time Off Breadth — PTO is generally described as decent or good, and many note it as a strong part of the package. Actual ability to take time off can depend on workload and team coverage.
  • Retirement Support — Offerings include a 401(k) with employer match and access to an employee stock purchase plan, which are highlighted as meaningful components of total rewards. These programs are consistently referenced among core benefits.
  • Parental & Family Support — Parental and caregiver leave, along with adoption assistance, are publicly highlighted and viewed as notable elements of the package. Availability can be role-specific, but these supports contribute to overall breadth where offered.

Optum Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Eden Prairie, MN
160,000 Employees
Year Founded: 2011

What We Do

Optum, part of the UnitedHealth Group family of businesses, is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. At Optum, we support your well-being with an understanding team, extensive benefits and rewarding opportunities. By joining us, you’ll have the resources to drive system transformation while we help you take care of your future. We recognize the power of connection to drive change, improve efficiency and make a difference in health care. Join a team where your skills and ideas can make an impact and where collaboration is key to creating technology that produces healthier outcomes.

Gallery

Gallery
Gallery
Gallery

Optum Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Optum has three workplace models that balance the needs of the business and the responsibilities of each role. These models, core on‑site (5 days/week), hybrid (4 days/week) and telecommute or fully remote, vary by country, role and location.

Typical time on-site: Not Specified
HQEden Prairie, MN
Metro Manila, Philippines
Cebu, Philippines
Davao, Philippines
Ann Arbor, MI
Atlanta, GA
Baltimore, MD
Bengaluru, India
Chennai, India
Dallas, TX
Detroit, MI
Dublin, Ireland
Hartford, CT
Houston, TX
Hyderabad, India
Jacksonville, FL
Las Vegas, NV
Letterkenny, Ireland
Louisville, KY
Madison, WI
Minneapolis, MN
Nashville, TN
New Delhi, India
Philadelphia, PA
Phoenix, AZ
Pune, India
Raleigh, NC
San Diego, CA
Washington, DC
Learn more

Similar Jobs

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Hybrid
Eden Prairie, MN, USA
160000 Employees
92K-164K Annually

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Eden Prairie, MN, USA
160000 Employees
92K-164K Annually

Optum Logo Optum

Integration Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Eden Prairie, MN, USA
160000 Employees
92K-164K Annually

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Minnetonka, MN, USA
160000 Employees
92K-164K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account