Lead Data Engineer

Posted 39 Minutes Ago
Easy Apply
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Expert/Leader
Healthtech • Software
Cohere Health provides clinical intelligence solutions to streamline payer and provider collaboration.
The Role
Leads the design and delivery of a cloud-native healthcare data platform. Responsibilities include building batch and near-real-time pipelines, implementing lakehouse architecture with Apache Iceberg, establishing data quality and observability frameworks, optimizing storage and query performance, and driving technical standards. The role also involves architecture reviews, code reviews, mentoring engineers, cross-functional collaboration, and information-security policy implementation.
Summary Generated by Built In

Opportunity Overview:

We are seeking a Lead Data Engineer to drive the design and delivery of our cloud-native healthcare data platform. You will lead the implementation of scalable data solutions built on AWS, Apache Iceberg, Lake Formation, Glue Catalog, Athena, dbt, and modern orchestration frameworks. This role combines deep hands-on engineering with technical leadership and collaboration across platform, analytics, and business teams.

What you’ll do:

  • Lead Data Engineering Initiatives 
  • Lead delivery of complex data engineering projects across multiple teams 
  • Drive technical execution from design through production deployment 
  • Establish scalable implementation patterns Build and Optimize Data Platforms 
  • Design and implement batch and near-real-time pipelines 
  • Build reusable ingestion, transformation, validation, and publishing frameworks 
  • Support modernization of legacy workloads Lakehouse Engineering 
  • Lead Apache Iceberg implementation and optimization 
  • Define standards for schema evolution, partitioning, compaction, and metadata management 
  • Ensure efficient storage and query performance Data Quality and Reliability 
  • Implement data quality frameworks 
  • Drive observability and monitoring practices 
  • Improve operational excellence and reliability Technical Leadership 
  • Review architecture and design proposals 
  • Conduct code reviews and engineering reviews 
  • Mentor engineers and establish best practices
  • Mentor engineers across levels, providing feedback, support, and growth opportunities aligned with career progression frameworks
  • Collaborate with Staff Engineers and Managers to define and evolve platform architecture, technical strategy, and system reliability goals
  • Act as a technical liaison between data platform engineering, analytics, and product teams—translating requirements into scalable, maintainable solutions

ISMS roles and responsibilities:

  • Good knowledge of Information practices.
  • Assist the manager in all the information security activities implementation and maintenance process.
  • Ensuring the  team and imparted with Competence related to Information security
  • Responsible for implementation of security policies and procedures and report any issues to the Information Security Manager.

What you’ll need:

Must-haves

  • 8–12 years of Data Engineering experience.
  • Healthcare claims and authorization datasets.(Insurance)
  • Experience leading enterprise-scale data initiatives Cloud Technologies 
  • AWS S3, Glue, Athena, Lake Formation 
  • IAM and security controls Modern Data Stack 
  • Apache Iceberg (preferred) 
  • Delta Lake / Hudi • dbt • Airflow or Step FunctionsProgramming 
  • Python 
  • SQL 
  • PySpark / Spark

Nice-to-haves

  • Kafka / AWS MSK 
  • SageMaker 
  • Atlan or similar catalogs 
  • Multi-tenant data platforms 
  • Data contracts and Data Mesh concepts
  • DBT

Ability to commute/relocate:

  • Hyderabad, Telangana: Reliably commute or planning to relocate before starting work (Preferred)

Interview Process*:

  1. Connect with Talent Acquisition 
  2. Meet with the Hiring Manager
  3. Behavioral Interview(s)
  4. Case Study
  5. Interview with Senior Leadership

*Subject to change

About Cohere Health:

Cohere Health’s clinical intelligence platform and agentic AI-powered solutions connect health plans’ strategic goals and providers’ needs, optimizing the speed, cost, and quality of care. With an enterprise approach that streamlines payer-provider decision-making across the care continuum–including policy, prior authorization, payment accuracy, and more–the company improves collaboration and reduces burden, resulting in up to 8x ROI and 94% provider satisfaction. 

With the acquisition of ZignaAI, we expanded our AI-native platform with a comprehensive Payment Integrity Suite that spans data mining, clinical and coding validation, authorization and claims reconciliation, and end-to-end payment integrity services across pre- and post-pay workflows. By connecting clinical and payment insights, our transparent, AI-powered solutions help health plans proactively improve payment accuracy, reduce waste and vendor dependency, strengthen provider relationships, and build smarter, more efficient payment integrity programs.

Cohere Health’s innovations continue to receive industry-wide recognition. We’ve been recognized on TIME’s World Top HealthTech Companies 2025 list, the 2025 Inc. 5000 list, in the Gartner® Hype Cycle™ for U.S. Healthcare Payers (2022-2025), and ranked as a Top 5 LinkedIn™ Startup for 2023 & 2024.

We can’t wait to learn more about you and meet you at Cohere Health!

Equal Opportunity Statement: 

Cohere Health is an Equal Opportunity Employer. We are committed to fostering an environment of mutual respect where equal employment opportunities are available to all.  To us, it’s personal.



Skills Required

  • 8-12 years of data engineering experience
  • Experience with healthcare claims and authorization datasets in insurance
  • Experience leading enterprise-scale data initiatives
  • Experience with AWS S3, Glue, Athena, and Lake Formation
  • Experience with IAM and security controls
  • Experience with Apache Iceberg
  • Experience with Delta Lake or Hudi
  • Experience with dbt
  • Experience with Airflow or AWS Step Functions
  • Proficiency in Python and SQL
  • Experience with PySpark or Spark
  • Knowledge of information security practices
  • Kafka or AWS MSK experience
  • SageMaker experience
  • Experience with Atlan or similar data catalogs
  • Experience with multi-tenant data platforms
  • Knowledge of data contracts and Data Mesh concepts
  • Reliable ability to commute to or relocate to Hyderabad, Telangana

What the Team is Saying

Kenji
Saranya
Emma
Brad
Jayna
Margot Hendrickson
Rachel Rabinowitz
Margot Hendrickson
Michelle Ford
Brad Smertz
Ben Barone
Brad Smertz
Kenji Fujita
Kenji Fujita
Therese Gorski
Sujata Patil
Therese Gorski
Kenji Fujita
Emma Nien
Gigi Yuen-Reed
Jason Ehule

Cohere Health Compensation & Benefits Highlights

  • Leave & Time Off Breadth — Leave policies include up to 184 hours (23 days) of PTO annually plus 10 company holidays, with additional recharge days also noted. This breadth of time off is consistently highlighted as a standout element of the package.
  • Parental & Family Support — Paid parental leave is advertised at up to 14 weeks, offering substantial support for growing families. This level of leave is positioned as a meaningful advantage relative to many employers.
  • Healthcare Strength — Medical, dental, vision, life and disability coverage are provided alongside HSA/FSA options and EAP resources. Multiple plan options and first‑day eligibility mentions indicate broad healthcare support.

Cohere Health Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Boston, MA
1,100 Employees
Year Founded: 2019

What We Do

Cohere Health’s clinical intelligence platform and agentic AI-powered solutions connect health plans’ strategic goals and providers’ needs, optimizing the speed, cost, and quality of care. With an enterprise approach that streamlines payer-provider decision-making across the care continuum–including policy, prior authorization, payment accuracy, and more–the company improves collaboration and reduces burden, resulting in up to 8x ROI and 94% provider satisfaction. With the acquisition of ZignaAI, we expanded our AI-native platform with a comprehensive Payment Integrity Suite that spans data mining, clinical and coding validation, authorization and claims reconciliation, and end-to-end payment integrity services across pre- and post-pay workflows. By connecting clinical and payment insights, our transparent, AI-powered solutions help health plans proactively improve payment accuracy, reduce waste and vendor dependency, strengthen provider relationships, and build smarter, more efficient payment integrity programs. Cohere Health’s innovations continue to receive industry-wide recognition. We’ve been recognized on TIME’s World Top HealthTech Companies 2025 list, the 2025 Inc. 5000 list, in the Gartner® Hype Cycle™ for U.S. Healthcare Payers (2022-2025), and ranked as a Top 5 LinkedIn™ Startup for 2023 & 2024.

Why Work With Us

Cohere Health brings together a community of healthcare and technology team members, passionate about changing the challenging parts of healthcare. If you enjoy solving challenging problems and learning about healthcare, then Cohere Health is a great career choice.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery

Cohere Health Offices

Remote Workspace

Employees work remotely.

Cohere Health employees work from all 50 states throughout the US - Cohere Health hosts retreats at our headquarters in Boston. Cohere Health employees based in Hyderabad, India, work in-office 5 days a week.

Typical time on-site:
HQBoston, MA
HiTech City & Nacharam
Learn more

Similar Jobs

Easy Apply
In-Office
Hyderabad, Telangana, IND
1100 Employees
Easy Apply
In-Office
Hyderabad, Telangana, IND
1100 Employees
Easy Apply
In-Office
Hyderabad, Telangana, IND
1100 Employees
Easy Apply
In-Office
Hyderabad, Telangana, IND
1100 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account