Our client is a large organization in the healthcare sector, undergoing a digital transformation focused on building a modern cloud-based data platform. The project aims to centralize data from multiple internal systems into a unified environment to improve accessibility, reporting, and analytical capabilities.
The team is working on implementing a scalable cloud data lake to enable efficient data processing, governance, and insights across departments. The solution will serve as the foundation for data-driven decision-making and future AI and analytics initiatives.
We are looking for a Junior/Intermediate PySpark Data Engineer – Data Migration (MS SQL / OCI) to join our team.
Overview:
We are looking for a motivated Junior/Intermediate PySpark Data Engineer to join our team and support the migration of enterprise datasets from Microsoft SQL Server to Oracle Cloud Infrastructure (OCI).
You will work with experienced engineers and data architects to develop and maintain PySpark-based ETL pipelines, ensure data quality, and help implement scalable, cloud-based data migration solutions.
Responsibilities:
- Develop and maintain PySpark ETL pipelines for extracting and loading data from MS SQL to OCI (Object Storage / Autonomous DB)
- Assist in building and maintaining metadata-driven ingestion and transformation processes
- Perform data profiling, validation, and reconciliation between source and target systems
- Support integration of OCI data services such as Data Flow, Data Integration, Object Storage, and Autonomous Database
- Work closely with senior engineers, data architects, and DBAs on migration tasks and performance tuning
- Document ETL processes, data mappings, and migration progress
- Participate in troubleshooting and resolving data or performance issues under guidance
Requirements:
- Two years of working experience in data engineering or a related technical field
- Practical experience with PySpark, Spark SQL, and Python (academic or commercial)
- Solid knowledge of SQL and basic experience with MS SQL Server (T-SQL)
- Understanding of ETL concepts, data quality, and data migration principles
- Familiarity with cloud data platforms (experience with OCI, AWS, or Azure is a plus)
- Basic knowledge of data modeling and schema mapping concepts
- Experience with version control tools (Git) and CI/CD workflows is an advantage
- Team-oriented mindset, curiosity, and willingness to learn new technologies
- Bachelor’s or Master’s degree in computer science (or similar technical field)
- Level of English: Upper-Intermediate (at least)
We Offer:
- Interesting and challenging projects
- Competitive compensation and regular results-based salary review
- A broad range of professional education and personal development possibilities
- Comfortable and cozy working environment
- Motivated colleagues with profound knowledge of the technical field
- Attractive compensation package
Accelerate your career with Leobit!
Top Skills
What We Do
Leobit is a full cycle web, .NET, and mobile application development provider for the technology companies and startups primarily located in the US, EU, and the UK.
Our technology focus covers .NET, Angular, Azure, iOS, Android, Ruby, PHP, React, Flutter, and a comprehensive range of other technologies from the Microsoft, Web, and Mobile Stacks.
Leobit has representative offices in Austin, TX (USA), Tallinn (Estonia), Krakow (Poland) and the development center in Lviv (Ukraine) with 170+ strong software engineers, architects, testers, and UI/UX designers available for outsourced development or team extension projects, as well as for technical application maintenance and support.
Leobit main achievements:
- Microsoft Solutions Partner for Digital & App Innovation
- ISO 9001:2015 and ISO 27001:2013 Certified
- Top .NET Developer in Ukraine 2023 by Clutch
- ISTQB Gold Partner
- Top Employer in Lviv, Ukraine 2023 by DOU
Contact us at [email protected] and get a quote for your project.
