DA Lead Data Engineer

Posted 9 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Healthtech • Biotech
The Role
Lead the design and implementation of scalable data ingestion pipelines and reusable data frameworks. Integrate source systems with target repositories while maintaining data quality, develop streaming and event-based processing solutions, evaluate technologies, analyze requirements, and present proofs of concept. The role requires expertise in PySpark, Python, Spark, Scala, cloud data warehouses, ETL, CI/CD, AWS, distributed data systems, data warehousing, and visualization tools.
Summary Generated by Built In

Labcorp is a global leader in laboratory services, providing the insights and answers that help healthcare providers, patients, researchers, pharmaceutical companies and health systems make confident decisions and improve outcomes. Through our unparalleled science, data, technology and laboratory network, we advance diagnostics, accelerate innovation and help address some of the world’s most important health challenges. As we shape the future of healthcare, we are leveraging advanced technologies, intelligent digital solutions and data-driven innovation across our operations to enhance how work gets done and deliver greater value to customers and patients. With our global scale and deep expertise, you’ll have the opportunity to do meaningful work, grow your career and make a real impact on people’s health around the world. Together, we’re improving health and improving lives.


Labcorp is a global leader in diagnostic testing and drug development solutions, helping healthcare providers, researchers, and patients make informed decisions that advance care. Join us in our mission to improve health and improve lives.

Labcorp is seeking a DA Lead Data Engineer to join our team at Bengaluru, India Office.

Work Schedule

Candidates are required to follow the work schedule from 2:00 PM to 11:00 PM IST.

Job Responsibilities: 

  • Designing and implementing highly performant data ingestion pipelines from multiple sources

  • Delivering and presenting proofs of concept to of key technology components to project stakeholders.

  • Developing scalable and re-usable frameworks for ingesting of data sets

  • Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times

  • Working with event based / streaming technologies to ingest and process data

  • Do analysis of new requirements and propose a solution

  • Evaluating the performance and applicability of multiple tools against customer requirements

Minimum Qualifications

  • Bachelor’s degree in computer science, Engineering, or related field.

  • 5 years or more of hands-on experience on PySpark, Python, Spark, Scala, Able to perform data validation, delivery, quality and integrity.

  • 5 years or more of Snowflake /Databricks Cloud Data Warehouse Implementation experience, should possess skill pertaining to handling various file formats (XML,JSON,Avro,Parquet)

  • 2 years of more experience in Extraction, Transformation and Loading (ETL) data from multiple data sources & various data formats (Structured, Semi-Structured & Unstructured).

  • 2 or more years of hands-on experience with Big Data model techniques using Python / Spark

  • 2 or more years of experience in CI/CD domain using Jenkins, Terraform, Docker, AWS, and Kubernetes.

Additional Job Standards

  • Should be able to work with modern schedulers (Airflow, Matillion, etc.) and distributed data systems such as Hadoop, Spark, Kafka etc.

  • Should have experience in business intelligence, reporting, and/or delivery of modern visualization solutions (Tableau, Power BI)

  • Good working exposure on cloud technologies of AWS - EC2, S3, Lambda, SQS, SNS

  • Strong Programming experience using PL/SQL packages, Stored procedures, views, Materialized views, triggers, Indexes etc.

  • Strong communication and collaboration skills.

  • Strong understanding on Data Warehousing concepts using Fact, Dimension tables and various methods of loading data.

  • Experience in Pharma industry is a plus.


Labcorp is proud to be an Equal Opportunity Employer:

Labcorp strives for inclusion and belonging in the workforce and does not tolerate harassment or discrimination of any kind. We make employment decisions based on the needs of our business and the qualifications and merit of the individual. Qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), family or parental status, marital, civil union or domestic partnership status, sexual orientation, gender identity, gender expression, personal appearance, age, veteran status, disability, genetic information, or any other legally protected characteristic. Additionally, all qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law. 


We encourage all to apply

If you are an individual with a disability who needs assistance using our online tools to search and apply for jobs, or needs an accommodation, please visit our accessibility site or contact us at Labcorp Accessibility. For more information about how we collect and store your personal data, please see our Privacy Statement.


Skills Required

  • Bachelor's degree in computer science, engineering, or a related field
  • At least 5 years of hands-on experience with PySpark, Python, Spark, and Scala
  • At least 5 years of Snowflake or Databricks cloud data warehouse implementation experience
  • Experience handling XML, JSON, Avro, and Parquet file formats
  • At least 2 years of ETL experience across multiple data sources and structured, semi-structured, and unstructured data
  • At least 2 years of experience with big data modeling using Python and Spark
  • At least 2 years of CI/CD experience using Jenkins, Terraform, Docker, AWS, and Kubernetes
  • Experience with Airflow, Matillion, Hadoop, Spark, and Kafka
  • Experience with business intelligence, reporting, or modern visualization solutions such as Tableau or Power BI
  • Working exposure to AWS EC2, S3, Lambda, SQS, and SNS
  • Strong programming experience with PL/SQL packages, stored procedures, views, materialized views, triggers, and indexes
  • Understanding of data warehousing concepts, including fact and dimension tables and loading methods
  • Strong communication and collaboration skills
  • Pharmaceutical industry experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Burlington, NC
19,796 Employees
Year Founded: 1978

What We Do

We believe in harnessing science for human good. And so we work day and night, around the world, to deliver answers for all your health questions—whether you’re a provider, drug developer, hospital, medical researcher or patient. That means everything from advancing diagnostic testing to helping launch new drugs, to offering new perspectives through data - all drawing from a deep well of scientific expertise. So when you need trusted information to make clear, confident health decisions, consider us your source.

Similar Jobs

Observe.AI Logo Observe.AI

Senior Data Engineer

Artificial Intelligence • Software
In-Office
Bengaluru, Karnataka, IND
253 Employees

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Support Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
85422 Employees

Wipfli Logo Wipfli

Consultant

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
2900 Employees

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Artificial Intelligence Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
85422 Employees

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees
Vitalize Thumbnail
Artificial Intelligence • Healthtech • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account