Principal Data Engineering - Remote - CST

Reposted 11 Days Ago
Be an Early Applicant
Hiring Remotely in Eden Prairie, MN, USA
In-Office or Remote
113K-193K Annually
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Role
Lead design and implementation of large-scale Azure cloud data systems and ETL/ELT pipelines using Databricks, Spark, Snowflake and LLM integrations. Build AI-driven solutions, optimize SQL performance, define architecture and best practices, mentor engineers, collaborate with stakeholders, and drive scalable, secure data platforms for analytics and machine learning.
Summary Generated by Built In
Requisition Number: 2366624
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
As a Principal Data Engineering professional within the Optum Insight Engineering AI team, you will design and develop robust public cloud data systems, services, and reusable patterns that drive massive scale and performance. Our team's vision is to deliver secure, private, and highly scalable Azure cloud solutions that enable the organization to utilize clean, reliable data safely and swiftly. In this role, you will lead the creation of modern ETL/ELT pipelines, Spark workflows, and AI integrations. Working with advanced platforms such as Azure Databricks, Snowflake, and LLMs, you will build data solutions that empower machine learning, insights generation, and business automation, directly contributing to better clinical and administrative connectivity across the healthcare system.
You'll enjoy the flexibility to work remotely* from anywhere within the U.S. during Central time zone business hours as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week.
Primary Responsibilities:
  • Design and Develop Scalable Cloud Applications: Develop services, controls, and reusable patterns (such as microservices and Azure functions) that enable the team to deliver value safely, quickly, and sustainably in the Azure public cloud while enabling security and privacy at scale
  • Build and Optimize Large-Scale Data Pipelines: Design, build, optimize, and manage modern large-scale data pipelines and ETL/ELT processing on Azure Databricks, LakeBase, and Apache Spark to support data integration, analytics, machine learning features, and predictive modeling
  • Deploy AI and Data-Driven Solutions: Develop and deploy large-scale data pipelines empowering machine learning algorithms, insights generation, business intelligence dashboards, reporting, and new data products while utilizing enterprise-approved AI tools to address complex business challenges
  • Develop AI-Powered Business Solutions: Build AI-based solutions for solving business needs, automating processes, and streamlining workflows to drive operational efficiency and continuous improvement
  • Architectural Evolution and Standards: Participate in the architectural evolution of data engineering patterns, frameworks, systems, and platforms, including defining best practices and standards for managing data collections and integrations
  • Improve System Quality and Data Reliability: Write advanced, complex SQL with performance tuning and optimization to identify and implement ways to improve data reliability, data integrity, system efficiency, and overall quality
  • Collaborative Leadership and Mentoring: Foster high-performance, collaborative technical work resulting in high-quality output. Mentor other data engineers, providing technical direction and training on leveraging cloud data platforms
  • Stakeholder and Requirement Analysis: Intersect skillfully with business stakeholders and third-party technical organizations to understand new product capabilities, decompose implementations into specific functional changes, analyze data for decision-making, and provide detailed, realistic estimates
  • Evaluate Emerging Trends: Evaluate emerging trends to inform solution design, strategic innovation, and the evolution of cloud data architectures
  • Best Practices in performance scalability and optimization

You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.
Required Qualifications:
  • Bachelor's degree or equivalent experience (such as an additional 8+ years of data engineering experience)
  • 10+ years of experience in data engineering, data integration, data modeling, data architecture, and ETL/ELT processes
  • 7+ years of experience in Python
  • 5+ years of experience in Apache Spark (PySpark/Spark SQL)
  • 5+ years of experience in SQL, including designing complex data schemas and query performance optimization
  • 3+ years of experience with API design and lifecycle management (GraphQL, REST, etc.)
  • 3+ years of experience building and deploying cloud-based solutions using Azure Databricks with UC, Snowflake, Functions, or Service Bus
  • 3+ years of experience with DevOps automation using Terraform
  • 3+ years of experience with CI/CD processes and tools (such as GitHub Actions, GIT, Artifactory, or Sonar)
  • 2+ years of experience building LLM integrations for workflow automation or business needs

Preferred Qualifications:
  • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related discipline
  • Healthcare and Provider domain experience
  • Experience working with LLMs
  • Extensive knowledge of data architecture principles (e.g., Data Lake, Databricks Delta Lake, Data Warehousing, etc.)
  • Extensive knowledge of data modeling techniques including slowly changing dimensions, aggregation, partitioning, and indexing strategies
  • Proven ability to independently troubleshoot and performance tune large-scale enterprise systems
  • Proven excellent collaborator with experience working effectively with cross-functional teams such as leadership, product management, and engineering, with a willingness to inspire other data engineers, data scientists, and analysts
  • Proven solid communication skills with the ability to communicate technical concepts to both technical and non-technical audiences

*All employees working remotely will be required to adhere to UnitedHealth Group's Telecommuter Policy.
Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $112,700 - $193,200 annually based on full-time employment. We comply with all minimum wage laws as applicable.
Application Deadline: This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected. Job posting may come down early due to volume of applicants.
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
UnitedHealth Group is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations.
UnitedHealth Group is a drug - free workplace. Candidates are required to pass a drug test before beginning employment.

Skills Required

  • Bachelor's degree or equivalent experience (or additional 8+ years of data engineering experience)
  • 10+ years of experience in data engineering, data integration, data modeling, data architecture, and ETL/ELT processes
  • 7+ years of experience in Python
  • 5+ years of experience in Apache Spark (PySpark/Spark SQL)
  • 5+ years of experience in SQL, including designing complex data schemas and query performance optimization
  • 3+ years of experience with API design and lifecycle management (GraphQL, REST)
  • 3+ years of experience building and deploying cloud-based solutions using Azure Databricks (with Unity Catalog), Snowflake, Azure Functions, or Service Bus
  • 3+ years of experience with DevOps automation using Terraform
  • 3+ years of experience with CI/CD processes and tools (such as GitHub Actions, Git, Artifactory, Sonar)
  • 2+ years of experience building LLM integrations for workflow automation or business needs
  • Ability to pass a pre-employment drug test
  • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related discipline
  • Healthcare and Provider domain experience
  • Experience working with LLMs (general experience beyond integrations)
  • Extensive knowledge of data architecture principles (Data Lake, Databricks Delta Lake, Data Warehousing)
  • Extensive knowledge of data modeling techniques including slowly changing dimensions, aggregation, partitioning, and indexing strategies
  • Proven ability to independently troubleshoot and performance tune large-scale enterprise systems
  • Proven collaboration and communication skills to work with cross-functional teams and convey technical concepts to non-technical audiences

What the Team is Saying

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Eden Prairie, MN
160,000 Employees
Year Founded: 2011

What We Do

Optum, part of the UnitedHealth Group family of businesses, is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. At Optum, we support your well-being with an understanding team, extensive benefits and rewarding opportunities. By joining us, you’ll have the resources to drive system transformation while we help you take care of your future. We recognize the power of connection to drive change, improve efficiency and make a difference in health care. Join a team where your skills and ideas can make an impact and where collaboration is key to creating technology that produces healthier outcomes.

Gallery

Gallery
Gallery
Gallery

Optum Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Optum has three workplace models that balance the needs of the business and the responsibilities of each role. These models, core on‑site (5 days/week), hybrid (4 days/week) and telecommute or fully remote, vary by country, role and location.

Typical time on-site: Not Specified
HQEden Prairie, MN
Metro Manila, Philippines
Cebu, Philippines
Davao, Philippines
Ann Arbor, MI
Atlanta, GA
Baltimore, MD
Bengaluru, India
Chennai, India
Dallas, TX
Detroit, MI
Dublin, Ireland
Hartford, CT
Houston, TX
Hyderabad, India
Jacksonville, FL
Las Vegas, NV
Letterkenny, Ireland
Louisville, KY
Madison, WI
Minneapolis, MN
Nashville, TN
New Delhi, India
Philadelphia, PA
Phoenix, AZ
Pune, India
Raleigh, NC
San Diego, CA
Washington, DC
Learn more

Similar Jobs

Optum Logo Optum

Epic MyChart Analyst - Remote

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Eden Prairie, MN, USA
160000 Employees
73K-130K Annually

Optum Logo Optum

Asymmetric Defense Engineer - Remote or Office-Based in MN or DC

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Eden Prairie, MN, USA
160000 Employees
113K-193K Annually

Optum Logo Optum

Accountant

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Eden Prairie, MN, USA
160000 Employees
60K-107K Annually

Optum Logo Optum

Manager, Advisory Services (AI Innovation/Predictive Analytics) - Remote

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Eden Prairie, MN, USA
160000 Employees
113K-193K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account