Associate Manager Data Analyst - Data Bricks

Reposted 17 Days Ago
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Role
The Associate Manager Data Analyst will design and optimize data analytics programs and pipelines, ensure data governance, and mentor junior analysts while maintaining best practices in ETL processes and using various technologies for data engineering tasks.
Summary Generated by Built In
Requisition Number: 2359924
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibilities:
  • Support the design, development, testing, and deployment of data analytics programs and processes for supporting various operational data stores using SAS, and Relational Databases
  • Collect, interpret, and aggregate data from traditional and non-traditional data sources for supporting programs and applications utilizing various data analytics purposes
  • Be able to understand data requirements and business need to develop data tools such as dashboards and data visualizations
  • Use business intelligence, data visualization, query, analytic and statistical software to build solutions, perform analysis and interpret data.
  • Solves moderately complex problems and can translate concepts into practice
  • Recognize problems and make recommendations for solutions
  • Works under minimal guidance and within tight deadlines for deliverables
  • Has an exploring mindset
  • Effectively interact with business users for new projects, enhancement projects, and issue resolution including addressing issues reported regarding data and existing applications
  • Adopts a structured approach focusing on understanding needs of business users, documenting requirements, and clarifying expectations. This involves active listening, utilizing various techniques to gather information, and ensuring clear communication to address any uncertainties or inconsistencies
  • Create and document high level design, detail design, implementation and standard operating procedures guides
  • Perform Production support tasks including job monitoring, addressing production failures, perform data analysis, root cause analysis and issue resolutions
  • Design, develop, and maintain scalable ETL/ELT pipelines using ADF, Python, Apache Spark, and PySpark in Databricks
  • Develop batch and incremental data processing pipelines handling large-scale structured, semi-structured and unstructured datasets
  • Implement optimized data transformation logic using Spark SQL and DataFrame APIs
  • Ensure pipelines follow enterprise data engineering best practices for performance, scalability, and maintainability
  • Implement reusable ingestion patterns and transformation templates aligned with enterprise architecture standards
  • Ensure compliance with enterprise metadata management, monitoring, and operational standards
  • Design and manage datasets stored in Apache Iceberg and Delta Lake (in open table formats)
  • Implement schema evolution, partitioning strategies, and version control for large datasets
  • Optimize data lake storage structures in Azure Data Lake Storage (ADLS)
  • Develop scalable pipelines using Databricks notebooks, jobs, and clusters
  • Manage dataset governance and access controls using Unity Catalog
  • Optimize Spark performance through partitioning, caching, and cluster tuning
  • Develop and schedule ETL pipelines using Apache Airflow
  • Implement dependency management, monitoring, alerting, and failure recovery mechanisms
  • Build pipelines that integrate with Snowflake data warehouse
  • Optimize transformations and data loading using Snowflake SQL and staging techniques
  • Design efficient data models for analytics and reporting
  • Support migration of legacy SAS pipelines to modern Spark-based frameworks and Databricks where applicable
  • Use Unix/Linux commands for common tasks and shell scripting to automate data engineering workflows
  • Support CI/CD deployment processes for ETL pipelines
  • Implement logging, auditing, and monitoring for production pipelines
  • Work with data architects, analysts, and business stakeholders to gather requirements and deliver data solutions
  • Participate in design reviews, architecture discussions, and code reviews
  • Mentor junior data engineers and provide technical guidance
  • Be the SME for DBX and do knowledge training for team
  • Focuses on building and optimizing large-scale data pipelines using ADF, Apache Iceberg, Delta Lake, cloud data lakes (ADLS/S3), and workflow orchestration tools like Airflow. The analyst will work closely with data architects, and platform teams to build reliable and governed data solutions aligned with enterprise standards
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:
  • Bachelor's degree in computer science, Computer Applications, Analytics, Data Science, or Information Technology
  • Certification on data bricks
  • 6+ years of experience in ETL / Data Engineering
  • 6+ years of experience working in Unix/Linux environments
  • 6+ years of experience writing Shell scripts
  • 6+ years of experience with ADF
  • 6+ years of experience working with large enterprise datasets
  • 5+ years of experience with programming using Python
  • 5+ years of experience with Databricks ecosystem including Lakehouse, Delta Lake, Workflows, Medallion Architecture, Apache SPARK, PySpark, Unity Catalog, Delta Sharing, Notebooks, SQL, GIT.
  • 4+ years of experience with Snowflake
  • Experience implementing governance using Unity Catalog
  • Experience working with Apache Iceberg or other open table formats
  • Experience working with Azure Data Lake Storage (ADLS) or AWS S3
  • Hands-on experience with Apache Airflow
  • Experience developing pipelines for Snowflake
  • Experience migrating SAS ETL pipelines to Spark and Databricks
  • Healthcare experience
  • Solid experience working with Databricks (Lakehouse, Delta Lake, Workflows, Medallion Architecture, Apache SPARK, Unity Catalog, Delta Sharing, Notebooks, SQL, GIT), PySpark, Python, Snowflake, and ADF frameworks
  • Knowledge of data governance frameworks
  • Good Knowledge on Azure services
  • Solid understanding of SAS programming, SAS Data step, SAS Macros, PROC SQL
  • Understanding of cloud data lake architecture
  • Proven solid analytical and troubleshooting skills
  • Proven excellent communication and collaboration abilities
  • Proven ability to work independently and mentor junior analysts
  • Proven solid documentation and design skills
  • Proven solid SQL skills

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
#NJP

Skills Required

  • Bachelor's degree in computer science, computer applications, analytics, data science, or information technology
  • Certification on Data Bricks
  • 6+ years of experience in ETL / Data Engineering
  • 6+ years of experience working in Unix/Linux environments
  • 6+ years of experience writing Shell scripts
  • 6+ years of experience with ADF
  • 6+ years of experience working with large enterprise datasets
  • 5+ years of experience with programming using Python
  • 5+ years of experience with Databricks ecosystem including Lakehouse, Delta Lake, Workflows, Medallion Architecture, Apache Spark, PySpark, Unity Catalog, Delta Sharing, Notebooks, SQL, GIT
  • 4+ years of experience with Snowflake
  • Experience implementing governance using Unity Catalog
  • Experience working with Apache Iceberg or other open table formats
  • Experience working with Azure Data Lake Storage (ADLS) or AWS S3
  • Hands-on experience with Apache Airflow
  • Experience developing pipelines for Snowflake
  • Experience migrating SAS ETL pipelines to Spark and Databricks
  • Healthcare experience
  • Solid experience working with Databricks, PySpark, Python, Snowflake, and ADF frameworks
  • Knowledge of data governance frameworks
  • Good Knowledge on Azure services
  • Solid understanding of SAS programming, SAS Data step, SAS Macros, PROC SQL
  • Understanding of cloud data lake architecture
  • Proven solid analytical and troubleshooting skills
  • Proven excellent communication and collaboration abilities
  • Proven ability to work independently and mentor junior analysts
  • Proven solid documentation and design skills
  • Proven solid SQL skills

What the Team is Saying

Optum Compensation & Benefits Highlights

  • Healthcare Strength Health coverage offers copay and HSA medical options with dental, vision, company‑paid life and disability, and free or low‑cost virtual visits. Feedback suggests the offering is comprehensive and competitive on paper.
  • Parental & Family Support Time off and family supports include PTO, eight paid holidays plus a floating day, six weeks paid parental leave, up to two weeks paid caregiver leave, Bright Horizons back‑up care, and adoption assistance up to $10,000. Feedback suggests these resources are meaningful for caregivers and family needs.
  • Retirement Support Savings programs include a 401(k) with employer match (after one year, vesting after two) and a 10%‑discount Employee Stock Purchase Plan. These programs bolster long‑term financial security when combined with other savings resources.

Optum Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Eden Prairie, MN
160,000 Employees
Year Founded: 2011

What We Do

Optum, part of the UnitedHealth Group family of businesses, is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. At Optum, we support your well-being with an understanding team, extensive benefits and rewarding opportunities. By joining us, you’ll have the resources to drive system transformation while we help you take care of your future. We recognize the power of connection to drive change, improve efficiency and make a difference in health care. Join a team where your skills and ideas can make an impact and where collaboration is key to creating technology that produces healthier outcomes.

Gallery

Gallery
Gallery
Gallery

Optum Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Optum has three workplace models that balance the needs of the business and the responsibilities of each role. These models, core on‑site (5 days/week), hybrid (4 days/week) and telecommute or fully remote, vary by country, role and location.

Typical time on-site: Not Specified
HQEden Prairie, MN
Metro Manila, Philippines
Cebu, Philippines
Davao, Philippines
Ann Arbor, MI
Atlanta, GA
Baltimore, MD
Bengaluru, India
Chennai, India
Dallas, TX
Detroit, MI
Dublin, Ireland
Hartford, CT
Houston, TX
Hyderabad, India
Jacksonville, FL
Las Vegas, NV
Letterkenny, Ireland
Louisville, KY
Madison, WI
Minneapolis, MN
Nashville, TN
New Delhi, India
Philadelphia, PA
Phoenix, AZ
Pune, India
Raleigh, NC
San Diego, CA
Washington, DC
Learn more

Similar Jobs

Optum Logo Optum

Machine Learning Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Machine Learning Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Senior Product Manager

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Business Systems Analyst

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account