Data Engineer

Reposted 17 Days Ago
Pittsburgh, PA
In-Office
Senior level
Biotech
Our Mission is to enable our customers to make the world healthier, cleaner and safer.
The Role
The Data Engineer will design and develop data integration solutions, facilitate requirements gathering, and innovate on data integration within a cloud environment, using various technologies such as Databricks and Apache Spark.
Summary Generated by Built In

Work Schedule

Standard (Mon-Fri)

Environmental Conditions

Office

Job Description

How will you make an impact?

Thermo Fisher Scientific is seeking a Data Engineer to work with the Data Science Center of Excellence and Data Architecture team! The data platform is primarily based on Oracle Exadata database, AWS Redshift and Databricks-based Delta and Unity Catalog technologies toward Lakehouse transition to enable Data Science, Data Analytics, Customer Analytics and Data Services for critical Application and Business enablement.

What will you do?

  • Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate Thermo Fisher enterprise systems in our Data Science and Enterprise Data Platform.
  • Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions integrate modern capabilities.
  • Facilitate capturing requirements and process mapping workshops, review business/functional requirement documents, author technical design documents, testing plans and scripts.
  • Assist with implementing standard operating procedures, facilitate review sessions with functional owners and end-user representatives, and leverage technical knowledge and expertise to drive improvements.
  • Defining, designing and documenting reference architecture and leading the implementation of BI and analytical solutions.
  • Follow agile development methodologies to deliver solutions and product features by following DevOps practices.
Experience, Knowledge, Skills, Abilities
  • 4-year degree with major in computer science engineering (or equivalent) from an accredited university (preferred) will substitute for minimum 4-5 years’ professional IT experience
  • Experience in ETL (Data extraction, data transformation and data load processes)
  • 6+ years working experience in data integration and pipeline development.
  • Proven track record using Databricks and Apache Spark.
  • Data lake and Delta lake and Unity Catalog experience with AWS Glue and Athena.
  • Demonstrated ability with AWS Cloud on data integration with Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB/DynamoDB ecosystems.
  • Strong real-life experience in Python development especially in pySpark in AWS Cloud environment
  • Design, develop test, deploy, maintain and improve data integration pipeline.
  • Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
  • Solid experience with source control systems including Git and Jenkins build and continuous integration tools.
  • Understanding of development methodology and actual experience writing functional and technical design specifications.
  • Must be willing to learn Generative AI.

Thermo Fisher Scientific is an EEO/Affirmative Action Employer and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other legally protected status.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Top Skills

Spark
Athena
Aws Glue
Aws Redshift
Databricks
DynamoDB
Elastic Search
Git
Jenkins
Kafka
Lambda
MongoDB
Oracle Exadata
Pyspark
Python
Rds
S3
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Waltham, MA
100,000 Employees

What We Do

Thermo Fisher Scientific Inc. is the world leader in serving science, with annual revenue of approximately $40 billion. Our Mission is to enable our customers to make the world healthier, cleaner and safer. Whether our customers are accelerating life sciences research, solving complex analytical challenges, increasing productivity in their laboratories, improving patient health through diagnostics or the development and manufacture of life-changing therapies, we are here to support them. Our global team delivers an unrivaled combination of innovative technologies, purchasing convenience and pharmaceutical services through our industry-leading brands, including Thermo Scientific, Applied Biosystems, Invitrogen, Fisher Scientific, Unity Lab Services, Patheon and PPD.

Why Work With Us

You will join a company which every colleague has the opportunity to create possibilities, for oneself, for our customers and patients. There is no more exciting place to be than at the forefront of solving problems which help improve lives around the world. As a company, we are committed to supporting your career aspirations and your journey.

Gallery

Gallery

Similar Jobs

The PNC Financial Services Group Logo The PNC Financial Services Group

Data Engineer

Machine Learning • Payments • Security • Software • Financial Services
Hybrid
Pittsburgh, PA, USA
55000 Employees
111K-172K Annually
In-Office
2 Locations
20252 Employees

Kyndryl Logo Kyndryl

Data Engineer

Cloud • Information Technology • Consulting
In-Office
20 Locations
46070 Employees
111K-253K Annually

The PNC Financial Services Group Logo The PNC Financial Services Group

Data Engineer

Machine Learning • Payments • Security • Software • Financial Services
Hybrid
Pittsburgh, PA, USA
55000 Employees

Similar Companies Hiring

Formation Bio Thumbnail
Pharmaceutical • Healthtech • Biotech • Big Data • Artificial Intelligence
New York, NY
140 Employees
SOPHiA GENETICS Thumbnail
Software • Healthtech • Biotech • Big Data • Artificial Intelligence
Boston, MA
450 Employees
Pfizer Thumbnail
Pharmaceutical • Natural Language Processing • Machine Learning • Healthtech • Biotech • Artificial Intelligence
New York, NY
121990 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account