Senior Big Data Engineer

Posted 6 Days Ago
Be an Early Applicant
Warsaw, Warszawa, Mazowieckie, POL
In-Office
189K-350K Annually
Senior level
Healthtech
The Role
Design, build, and operate large-scale data pipelines on Databricks/Azure to process billions of healthcare records. Lead delivery, mentor engineers, perform data profiling, implement ETL, ensure data quality, write automated tests, and collaborate with architects and QA to deploy and maintain production systems.
Summary Generated by Built In
Senior Big Data Engineer The Role    

We are looking for an experienced, innovative and highly motivated engineer who is capable of working independently to design, develop, and support data engineering solutions. This role requires a considerable focus on understanding our data we deal with as an organization, develop a better understanding of our data through profiling, take ownership of the solution design, work collaboratively with the wider engineering team to implement optimal solutions in a timely manner and ensure successful deployment and operation of the platform in production. Our platform helps solve complex business challenges pertaining to healthcare data such as mapping wide variety of healthcare drug and diagnosis data to standard coding frames. You will have the opportunity to solve complex engineering challenges and develop innovative solutions.  In your daily work you will be responsible for creation and delivery of a platform loading and processing millions of electronic medical records.

The Team 

The Systems Engineering team is part of the Global Infrastructure & Operations (GIO) and remains one of the most dynamic and fast-growing groups in the organisation. We are passionate about Agile software development and are among the strongest advocates for DevOps and Test-Driven Development (TDD). Our culture promotes autonomy and collaboration, empowering individuals to thrive within self-organising teams. Our work involves processing and analysing a wide range of patient-level healthcare data, which supports solving complex healthcare challenges — from retrospective clinical studies to disease progression modelling.

In your daily activities, you will collaborate with a team of Architects who design effective solutions, and with the Quality Assurance team, which ensures the highest standards of software quality.

The Data

We process over a billion records at a time; our engineers are responsible for the data analysis and construction and optimization of data flow processes. You will build data pipeline using ETL solutions for acquiring, processing and loading medical data into the Databricks.

Core Responsibilities  
  • Ability to oversee and guide junior and mid-level engineers, providing technical direction and mentoring to support their growth.
  • Delegating tasks effectively, ensuring clarity of expectations and alignment with delivery goals.
  • Ownership for the delivery of assigned workstreams, ensuring quality, timeliness, and accountability across the team.
  • Build pipelines for processing big amount of medical data
  • Participate in analysis, system design, development, deployment and maintenance 
  • Conduct peer code reviews
  • Contribute to the definition and adoption of technical standards
  • Create comprehensive automated unit and integration tests 
QUALIFICATIONS & SKILLS Qualifications 

Bachelor’s Degree in Information Technology, Software Engineering, Computer Science, Mathematics, or another related field 

Technical skills and knowledge  
  • 6+ years of the following language: SQL, Python, Scala
  • 6+ years of experience in data engineering
  • Strong understanding of Databricks platform
  • Experience with Big Data Batch processing and Azure Cloud Services
  • Practical knowledge of Apache Spark ecosystem, including Delta and Parquet data formats
  • Experience with complex ETL design and implementation
  • Experience with data analysis, data profiling, data integration, data quality, data warehousing, data reporting
  • Experience with CI/CD automation processes and tools such as Jenkins/GitLab
Additional/nice to have
  • Familiarity with AI-powered productivity tools such as Copilot or Cursor, and their practical use in day-to-day software development workflows (e.g. code generation, documentation, task automation, or debugging support).
  • Experience working in an Agile environment
  • Experience with database design and modelling
  • Previous experience with healthcare or pharmaceutical data would be an advantage
  • Knowledge of algorithms & design patterns and how to apply them effectively  
  • Experience with large data volume (TBs’) processing  

 Personal skills and behaviours 

  • Excellent analytical & troubleshooting skills 
  • Strong collaboration, written, and verbal skills 
  • Familiarity with project management concepts, specifically Agile/Scrum  
  • Ability to present complex results in a clear language for both technical and non-technical audience
  • Experience collaborating with teams from Europe, with an understanding of cross-cultural communication and remote delivery dynamics
  • A great team player mindset

What we offer

  • Work in a company with offices in over 100 countries around the world, listed on the American stock exchange (NYSE)
  • Multi-terabyte databases
  • Quarterly work planning - goals and progress review every 90 days
  • Technical training
  • Possibility to participate in technical conferences within the country
  • Favourable employment conditions and benefits

IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create intelligent connections to accelerate the development and commercialization of innovative medical treatments to help improve patient outcomes and population health worldwide. Learn more at https://jobs.iqvia.com

IQVIA is committed to integrity in our hiring process and maintains a zero tolerance policy for candidate fraud. All information and credentials submitted in your application must be truthful and complete. Any false statements, misrepresentations, or material omissions during the recruitment process will result in immediate disqualification of your application, or termination of employment if discovered later, in accordance with applicable law. We appreciate your honesty and professionalism.

The potential base pay range for this role, when annualized, is zł188,700.00 - zł350,200.00. The actual base pay offered may vary based on a number of factors including job-related qualifications such as knowledge, skills, education, and experience; location; and/or schedule (full or part-time). Dependent on the position offered, incentive plans, bonuses, and/or other forms of compensation may be offered, in addition to a range of health and welfare and/or other benefits.

Skills Required

  • Bachelor's Degree in Information Technology, Software Engineering, Computer Science, Mathematics, or related field
  • 6+ years of experience with SQL
  • 6+ years of experience with Python
  • 6+ years of experience with Scala
  • 6+ years of experience in data engineering
  • Strong understanding of the Databricks platform
  • Experience with Big Data batch processing and Azure Cloud Services
  • Practical knowledge of the Apache Spark ecosystem, including Delta and Parquet data formats
  • Experience with complex ETL design and implementation
  • Experience with data analysis, data profiling, data integration, data quality, data warehousing, and reporting
  • Experience with CI/CD automation processes and tools (e.g., Jenkins, GitLab)
  • Ability to oversee and guide junior and mid-level engineers, provide technical direction and mentoring
  • Create comprehensive automated unit and integration tests
  • Familiarity with AI-powered tools such as Copilot or Cursor
  • Experience working in an Agile environment
  • Experience with database design and modelling
  • Previous experience with healthcare or pharmaceutical data
  • Knowledge of algorithms and design patterns
  • Experience processing very large data volumes (TBs)

IQVIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about IQVIA and has not been reviewed or approved by IQVIA.

  • Healthcare Strength Healthcare coverage is positioned as comprehensive, spanning medical/dental/vision plus programs like telemedicine, EAP resources, and additional insurance options. Feedback suggests the health offering is a meaningful part of the overall rewards package, though details can vary by location and plan design.
  • Retirement Support Retirement benefits include an employer match structure that supports employee contributions through a defined formula. This adds steady long-term value to total rewards beyond base salary.
  • Leave & Time Off Breadth Time off offerings include vacation/paid time off, holidays, and flexibility themes, with some roles described as having discretionary or unlimited time-off models. This can make the package feel more attractive even when cash compensation is viewed as only mid-range.

IQVIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Durham, NC
61,500 Employees
Year Founded: 2016

What We Do

IQVIA (NYSE:IQV) is a leading global provider of advanced analytics, technology solutions, and clinical research services to the life sciences industry. IQVIA creates intelligent connections across all aspects of healthcare through its analytics, transformative technology, big data resources and extensive domain expertise. IQVIA Connected Intelligence™ delivers powerful insights with speed and agility — enabling customers to accelerate the clinical development and commercialization of innovative medical treatments that improve healthcare outcomes for patients. With approximately 70,000 employees, IQVIA conducts operations in more than 100 countries. To learn more, visit www.iqvia.com.

Similar Jobs

Ericsson Logo Ericsson

Service Delivery Manager Associate

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
Warszawa, Mazowieckie, POL
88000 Employees

UL Solutions Logo UL Solutions

Project Engineer

Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Hybrid
2 Locations
15000 Employees

UL Solutions Logo UL Solutions

Manager, Process Excellence (People Operations & HR Transformation)

Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Hybrid
3 Locations
15000 Employees

UL Solutions Logo UL Solutions

Senior Payroll Coordinator

Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Remote or Hybrid
Poland
15000 Employees

Similar Companies Hiring

Sailor Health Thumbnail
Healthtech • Social Impact • Telehealth
New York City, NY
20 Employees
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
OneImaging Thumbnail
Healthtech
Miami, FL
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account