Lead Data Engineer – Cloud Data Products & Analytic Enablement

Posted Yesterday
50 Locations
In-Office or Remote
118K-197K Annually
Senior level
Healthtech
The Role
Leads the design, development, and maintenance of scalable cloud data pipelines, warehouses, models, and analytical data products. Uses GCP services, SQL, Python, and modern data engineering tools to ingest, transform, govern, and optimize data. Partners with business, product, IT, and analytics stakeholders to translate requirements into solutions, ensures data quality and compliance, monitors delivery, and mentors data engineers.
Summary Generated by Built In
Company :Highmark HealthJob Description : 

JOB SUMMARY

***CANDIDATE MUST BE US Citizen (due to contractual/access requirements)***

As a Lead Data Engineer – Cloud Data Products & Analytic Enablement, you will be instrumental in transforming diverse data sources into actionable intelligence, empowering critical business decisions across our organization and within our application ecosystem.  

This pivotal role demands a strong foundation in data engineering principles, combined with a keen focus on analytical engineering to unlock the full potential of our data assets. 

You will leverage your deep expertise in Google Cloud Platform (GCP) technologies, including Managed Airflow (Cloud Composer), BigQuery, Cloud Run Functions, DataFlow, DataProc, and DataPlex, to design, build, and optimize scalable data pipelines.  

Your work will encompass the entire data lifecycle from ingestion and processing to modeling and orchestration, ensuring the highest standards of data quality, performance, and governance. 

A core aspect of this role involves translating complex engineered data into readily consumable, business-ready insights. You will achieve this by developing curated datasets and robust analytical assets.  

Success in this position requires exceptional proficiency in SQL and Python, coupled with the ability to strategically partner with diverse stakeholders, translating intricate business requirements into impactful, scalable data products. 

ESSENTIAL RESPONSIBILITIES

  • Lead the design, develop, and maintain robust data processes and solutions to ensure the efficient movement and transformation of data across multiple systems

  • Oversee development and maintain data models, databases, and data warehouses to support business intelligence and analytics needs

  • Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs

  • Mentor other associate, intermediate, and senior data engineers as needed

  • Collaborate with other Data Leaders to ensure consistency of data solutions across systems and platforms

  • Monitor work against the production schedule, provide progress updates, and report any issues or technical difficulties to lead developers regularly

  • Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations.

  • Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed

  • Other duties as assigned or requested.

EXPERIENCE

Required

  • 7 years of experience in design and analysis of algorithms, data structures, and design patterns in the building and deploying of scalable, highly available systems

  • 7 years of experience in a data engineering, ETL development, or data management role.

  • 7 years of experience in SQL and experience with database technologies (e.g., MySQL, PostgreSQL, MongoDB).

  • 7 years of experience in with data warehouse solutions and concepts (e.g., Snowflake, Redshift, BigQuery)

Preferred

  • 7+ years of experience in designing, developing, and meticulously implementing robust data solutions, encompassing sophisticated structuring and transformation of data from diverse, complex source systems.
  • 7+ years of experience in producing high-quality, efficient, and maintainable data-related code that underpins critical stakeholder applications.
  • 7+ years of experience working across a multitude of technology systems, consistently designing innovative solutions or developing impactful data solutions specifically within the complex healthcare or insurance industry.
  • 7+ years of experience in strategically translating intricate business requirements, design mockups, prototypes, and user stories into precise technical designs and highly impactful, scalable data solutions.
  • 7+ years of experience with both SQL and Python, utilizing these languages for sophisticated data manipulation, advanced analytical insights, and the development of resilient data pipelines.
  • 5+ years of experience leveraging core GCP data services, including BigQuery, DataFlow, Cloud Composer (Managed Airflow), DataProc, and Cloud Run, optimizing their use for cloud-native data architectures.
  • 5+ years of experience with traditional on-premise database systems, including Oracle, Teradata, and DB2, bridging legacy and modern data landscapes.
  • 5+ years of experience operating within Unix/Linux environments, including scripting and system-level data operations.
  • Possesses proven, hands-on experience with dbt (data build tool) for advanced data transformation and the development of sophisticated analytical data models.
  • Experienced with data virtualization tools such as Starburst (Trino) or other composable data platforms, enabling unified access to distributed data assets.
  • Skilled in leveraging advanced data quality engines (e.g., Monte Carlo, Soda) to ensure proactive data observability, integrity, and reliability across the data landscape.
  • Familiar with sophisticated data catalog systems (e.g., Atlan, Collibra) for comprehensive metadata management, discovery, and robust data governance.
  • Holds practical experience with Lakehouse technologies and modern open table formats (e.g., Apache Iceberg, Delta Lake), contributing to scalable and flexible data architectures.

SKILLS

  • Demonstrated ability to achieve stretch goals in a highly innovative and fast-paced environment

  • Adaptability: Advanced ability to take on diverse tasks and projects, adapting to the evolving needs of the organization

  • Analytical Thinking: Advanced analytical skills with a focus on detail and accuracy

  • Interest and ability to learn other data development technologies/languages as needed

  • Technical Proficiency: Comfortable with a range of data tools and technologies, with a willingness to learn new skills as needed

  • Advanced track record in designing and implementing large-scale data sources

  • Advanced sense of ownership, urgency, and drive

  • Demonstrated passion for user experience and improving usability

  • Team Collaboration: A team player who can work effectively in cross-functional environments

  • Experience and willingness to mentor junior data engineers and help develop their skills and leadership

EDUCATION

Required

  • Bachelor’s degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field

Preferred

  • Master's degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field

LICENSES or CERTIFICATIONS

Required

  • None

Preferred

  • None

Language (Other than English):

None

Travel Requirement:

0% - 25%

PHYSICAL, MENTAL DEMANDS and WORKING CONDITIONS

Position Type

Office- or Remote-based

Teaches / trains others

Occasionally

Travel from the office to various work sites or from site-to-site

Rarely

Works primarily out-of-the office selling products/services (sales employees)

Never

Physical work site required

No

Lifting: up to 10 pounds

Constantly

Lifting: 10 to 25 pounds

Occasionally

Lifting: 25 to 50 pounds

Rarely

Disclaimer: The job description has been designed to indicate the general nature and essential duties and responsibilities of work performed by employees within this job title. It may not contain a comprehensive inventory of all duties, responsibilities, and qualifications required of employees to do this job.
Compliance Requirement: This job adheres to the ethical and legal standards and behavioral expectations as set forth in the code of business conduct and company policies.

As a component of job responsibilities, employees may have access to covered information, cardholder data, or other confidential customer information that must be protected at all times.  In connection with this, all employees must comply with both the Health Insurance Portability Accountability Act of 1996 (HIPAA) as described in the Notice of Privacy Practices and Privacy Policies and Procedures as well as all data security guidelines established within the Company’s Handbook of Privacy Policies and Practices and Information Security Policy. 
Furthermore, it is every employee’s responsibility to comply with the company’s Code of Business Conduct. This includes but is not limited to adherence to applicable federal and state laws, rules, and regulations as well as company policies and training requirements.

Pay Range Minimum:

$118,400.00

Pay Range Maximum:

$196,800.00

Base pay is determined by a variety of factors including a candidate’s qualifications, experience, and expected contributions, as well as internal peer equity, market, and business considerations.  The displayed salary range does not reflect any geographic differential Highmark may apply for certain locations based upon comparative markets.

Highmark Health and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law.

We endeavor to make this site accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact the email below.

For accommodation requests, please contact HR Services Online at [email protected]

California Consumer Privacy Act Employees, Contractors, and Applicants Notice

Skills Required

  • Must be a United States citizen due to contractual and access requirements
  • Bachelor’s degree in Computer Science, Information Systems, Data Science, Computer Engineering, or a related field
  • 7 years of experience designing and analyzing algorithms, data structures, and design patterns for scalable, highly available systems
  • 7 years of experience in data engineering, ETL development, or data management
  • 7 years of experience with SQL and database technologies such as MySQL, PostgreSQL, or MongoDB
  • 7 years of experience with data warehouse solutions and concepts such as Snowflake, Redshift, or BigQuery
  • 7 or more years designing and implementing data solutions involving complex source systems
  • 7 or more years producing high-quality, maintainable data-related code for stakeholder applications
  • 7 or more years working across technology systems, preferably in healthcare or insurance
  • 7 or more years translating business requirements, mockups, prototypes, and user stories into technical data designs
  • 7 or more years using SQL and Python for data manipulation, analytics, and data pipelines
  • 5 or more years with GCP data services including BigQuery, Dataflow, Cloud Composer, Dataproc, and Cloud Run
  • 5 or more years with Oracle, Teradata, and DB2
  • 5 or more years working in Unix/Linux environments, including scripting and system-level data operations
  • Hands-on experience with dbt for data transformation and analytical data modeling
  • Experience with data virtualization tools such as Starburst or Trino
  • Experience with data quality and observability tools such as Monte Carlo or Soda
  • Experience with data catalog systems such as Atlan or Collibra
  • Experience with Lakehouse technologies and open table formats such as Apache Iceberg or Delta Lake
  • Master’s degree in Computer Science, Information Systems, Data Science, Computer Engineering, or a related field

Highmark Health Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Highmark Health and has not been reviewed or approved by Highmark Health.

  • Healthcare Strength Medical, prescription, dental, and vision coverage are emphasized alongside 100% coverage for preventive exams, with onsite pharmacy access and fitness center availability at major campuses.
  • Retirement Support An employer‑sponsored 401(k) with a company match is highlighted, with AHN materials illustrating a 100% match on the first 4% plus an additional 1% employer contribution as an example within the enterprise.
  • Wellbeing & Lifestyle Benefits Wellness programs include stress‑management classes, health coaching, incentives for healthy activities, team‑member discounts, and volunteer incentives, with paid volunteer time also noted in the overall package.

Highmark Health Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Pittsburgh, PA
17,989 Employees
Year Founded: 1977

What We Do

Highmark Health, a Pittsburgh, PA based enterprise that employs more than 40,000 people who serve millions of Americans across the country, is the second largest integrated health care delivery and financing network in the nation based on revenue. Highmark Health is the parent company of Highmark Inc., Allegheny Health Network, and HM Health Solutions. Highmark Inc. and its subsidiaries and affiliates provide health insurance to nearly 5 million members in Pennsylvania, West Virginia and Delaware as well as dental insurance, vision care and related health products through a national network of diversified businesses that include United Concordia Companies, HM Insurance Group, and Visionworks. Allegheny Health Network is the parent company of an integrated delivery network that includes eight hospitals, more than 2,800 affiliated physicians, ambulatory surgery centers, an employed physician organization, home and community-based health services, a research institute, a group purchasing organization, and health and wellness pavilions in western Pennsylvania. HM Health Solutions focuses on meeting the information technology platform and other business needs of the Highmark Health enterprise as well as unaffiliated health insurance plans by providing proven business processes, expert knowledge and integrated cloud-based platforms. A national blended health organization, Highmark Health and our leading businesses support millions of customers with products, services and solutions closely aligned to our mission of creating remarkable health experiences, freeing people to be their best. Headquartered in Pittsburgh, we're regionally focused in Pennsylvania, Delaware, West Virginia and New York, with customers in all 50 states and the District of Columbia. We passionately serve individual consumers and fellow businesses alike. Our companies cover a diversified spectrum of essential health-related needs, including health insurance, health care delivery, population health management, dental solutions, reinsurance solutions, and innovative technology solutions. We’re also proud to carry forth an important legacy of compassionate care and philanthropy that began more than 170 years ago. This tradition of giving back, reinvesting and ensuring that our communities remain strong and healthy is deeply embedded in our culture, informing our decisions every day.

Similar Jobs

Zscaler Logo Zscaler

Senior Manager, Enterprise Data Platform

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
USA
8697 Employees
196K-245K Annually

Shield AI Logo Shield AI

Systems Engineer

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
In-Office or Remote
5 Locations
144K-210K Annually

Shield AI Logo Shield AI

Senior Systems Engineer

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
In-Office or Remote
5 Locations
144K-210K Annually

Dropbox Logo Dropbox

Senior Manager, Sales Operations

Artificial Intelligence • Cloud • Consumer Web • Productivity • Software • App development • Data Privacy
Remote
United States
2500 Employees
191K-258K Annually

Similar Companies Hiring

Sailor Health Thumbnail
Healthtech • Social Impact • Telehealth
New York City, NY
20 Employees
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account