Lead Data Engineer

Posted 3 Hours Ago
Easy Apply
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Healthtech • Software
Cohere Health provides clinical intelligence solutions to streamline payer and provider collaboration.
The Role
Lead the design and delivery of a cloud-native healthcare data platform on AWS. Architect and implement scalable batch and near-real-time pipelines, lead Apache Iceberg lakehouse engineering, build reusable ingestion/transformation/validation frameworks, drive data quality, observability, and operational excellence, review architectures, conduct code reviews, mentor engineers, and collaborate across platform, analytics, and business teams.
Summary Generated by Built In

Opportunity Overview:

We are seeking a Lead Data Engineer to drive the design and delivery of our cloud-native healthcare data platform. You will lead the implementation of scalable data solutions built on AWS, Apache Iceberg, Lake Formation, Glue Catalog, Athena, dbt, and modern orchestration frameworks. This role combines deep hands-on engineering with technical leadership and collaboration across platform, analytics, and business teams.

What you’ll do:

  • Lead Data Engineering Initiatives 
  • Lead delivery of complex data engineering projects across multiple teams 
  • Drive technical execution from design through production deployment 
  • Establish scalable implementation patterns Build and Optimize Data Platforms 
  • Design and implement batch and near-real-time pipelines 
  • Build reusable ingestion, transformation, validation, and publishing frameworks 
  • Support modernization of legacy workloads Lakehouse Engineering 
  • Lead Apache Iceberg implementation and optimization 
  • Define standards for schema evolution, partitioning, compaction, and metadata management 
  • Ensure efficient storage and query performance Data Quality and Reliability 
  • Implement data quality frameworks 
  • Drive observability and monitoring practices 
  • Improve operational excellence and reliability Technical Leadership 
  • Review architecture and design proposals 
  • Conduct code reviews and engineering reviews 
  • Mentor engineers and establish best practices

Required Qualifications:

  • 8–12 years of Data Engineering experience.
  • Experience leading enterprise-scale data initiatives Cloud Technologies 
  • AWS S3, Glue, Athena, Lake Formation 
  • IAM and security controls Modern Data Stack 
  • Apache Iceberg (preferred) 
  • Delta Lake / Hudi • dbt • Airflow or Step FunctionsProgramming 
  • Python 
  • SQL 
  • PySpark / Spark

Interview Process*:

  1. Connect with Talent Acquisition 
  2. Meet with the Hiring Manager
  3. Behavioral Interview(s)
  4. Case Study
  5. Interview with Senior Leadership

*Subject to change

About Cohere Health:

Cohere Health’s clinical intelligence platform delivers AI-powered solutions that streamline access to quality care by improving payer-provider collaboration, cost containment, and healthcare economics. Cohere Health works with over 660,000 providers and handles over 12 million prior authorization requests annually. Its responsible AI auto-approves up to 90% of requests for millions of health plan members.

With the acquisition of ZignaAI, we’ve further enhanced our platform by launching our Payment Integrity Suite, anchored by Cohere Validate™, an AI-driven clinical and coding validation solution that operates in near real-time. By unifying pre-service authorization data with post-service claims validation, we’re creating a transparent healthcare ecosystem that reduces waste, improves payer-provider collaboration and patient outcomes, and ensures providers are paid promptly and accurately.

Cohere Health’s innovations continue to receive industry wide recognition. We’ve been named to the 2025 Inc. 5000 list and in the Gartner® Hype Cycle™ for U.S. Healthcare Payers (2022-2025), and ranked as a Top 5 LinkedIn™ Startup for 2023 & 2024. Backed by leading investors such as Deerfield Management, Define Ventures, Flare Capital Partners, Longitude Capital, and Polaris Partners, Cohere Health drives more transparent, streamlined healthcare processes, helping patients receive faster, more appropriate care and higher-quality outcomes.

The Coherenauts, as we call ourselves, who succeed here are empathetic teammates who are candid, kind, caring, and embody our core values and principles. We believe that diverse, inclusive teams make the most impactful work. Cohere is deeply invested in ensuring that we have a supportive, growth-oriented environment that works for everyone.

We can’t wait to learn more about you and meet you at Cohere Health!

Equal Opportunity Statement: 

Cohere Health is an Equal Opportunity Employer. We are committed to fostering an environment of mutual respect where equal employment opportunities are available to all.  To us, it’s personal.

ISMS roles and responsibilities

  • Good knowledge of Information security
  • Oversee specific business processes within the ISMS.
  • Responsible to manage the ISMS documentation, conduct risk assessments, and implement risk treatment plans.
  • Risk Owners are responsible for identifying, assessing, and managing risks within their areas of responsibility.
  • They are also responsible for implementing risk treatment plans.
  • Conduct the BCP and other test related to information security continuity along with CISO
  • Responsible for monitoring and reporting on the performance of the ISMS.
  • Responsible for implementation of security policies and procedures and report any issues to the CISO.

Skills Required

  • 8-12 years of Data Engineering experience
  • Experience leading enterprise-scale data initiatives
  • AWS S3
  • AWS Glue
  • Glue Catalog
  • AWS Lake Formation
  • AWS Athena
  • IAM and security controls
  • Apache Iceberg
  • Delta Lake or Hudi
  • dbt
  • Airflow or AWS Step Functions
  • Python
  • SQL
  • PySpark / Spark
  • Good knowledge of information security and ISMS practices

What the Team is Saying

Kenji
Saranya
Emma
Brad
Jayna

Cohere Health Compensation & Benefits Highlights

  • Leave & Time Off Breadth Policies indicate PTO of about 23 days per year plus 10 company holidays, with wellness and floating holidays also highlighted on some listings. This breadth is emphasized across official materials and third‑party profiles.
  • Parental & Family Support Offerings include up to 14 weeks of paid parental leave in the U.S., alongside adoption and fertility support. These provisions are consistently presented as part of a people‑first policy set.
  • Healthcare Strength Coverage spans medical, dental, vision, life and disability insurance, plus EAP and mental‑health benefits; transgender health care benefits are also called out. Plan summaries on the benefits portal indicate established carrier options and clear documentation.

Cohere Health Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Boston, MA
900 Employees
Year Founded: 2019

What We Do

Cohere Health’s clinical intelligence platform and agentic AI-powered solutions connect health plans’ strategic goals and providers’ needs, optimizing the speed, cost, and quality of care. With an enterprise approach that streamlines payer-provider decision-making across the care continuum–including policy, prior authorization, payment accuracy, and more–the company improves collaboration and reduces burden, resulting in up to 8x ROI and 94% provider satisfaction. With the acquisition of ZignaAI, we expanded our AI-native platform with a comprehensive Payment Integrity Suite that spans data mining, clinical and coding validation, authorization and claims reconciliation, and end-to-end payment integrity services across pre- and post-pay workflows. By connecting clinical and payment insights, our transparent, AI-powered solutions help health plans proactively improve payment accuracy, reduce waste and vendor dependency, strengthen provider relationships, and build smarter, more efficient payment integrity programs. Cohere Health’s innovations continue to receive industry-wide recognition. We’ve been recognized on TIME’s World Top HealthTech Companies 2025 list, the 2025 Inc. 5000 list, in the Gartner® Hype Cycle™ for U.S. Healthcare Payers (2022-2025), and ranked as a Top 5 LinkedIn™ Startup for 2023 & 2024.

Why Work With Us

Cohere Health brings together a community of healthcare and technology team members, passionate about changing the challenging parts of healthcare. If you enjoy solving challenging problems and learning about healthcare, then Cohere Health is a great career choice.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery

Cohere Health Offices

Remote Workspace

Employees work remotely.

Cohere employees work from 45 different states throughout the US - Cohere hosts retreats at our headquarters in Boston. ZignaAI, a Cohere Health Company, employees based in Hyderabad, India, work in-office 5 days a week.

Typical time on-site:
HQBoston, MA
Hyderabad, Telangana
Learn more

Similar Jobs

Cohere Health Logo Cohere Health

Data Engineer

Healthtech • Software
Easy Apply
In-Office
Hyderabad, Telangana, IND
900 Employees
Easy Apply
In-Office
Hyderabad, Telangana, IND
900 Employees
7-7 Annually

Cohere Health Logo Cohere Health

Platform Engineer

Healthtech • Software
Easy Apply
In-Office
Hyderabad, Telangana, IND
900 Employees
Easy Apply
In-Office
Hyderabad, Telangana, IND
900 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account