The Role
Develop and maintain scalable data pipelines for transformation, integration, and loading. Ensure data quality, integrity, security, monitoring, and error handling while optimizing workflows for performance and reliability. Collaborate with data scientists, analysts, business stakeholders, and third-party vendors to meet analytical and business needs. Drive continuous improvement using modern big data technologies and best practices.
Summary Generated by Built In
- Data Pipeline Development: Build and maintain scalable data pipelines that support data transformation, integration, and loading across the data platform.
- Data Integrity & Quality: Ensure the integrity, quality, and security of data across the platform by implementing and developing appropriate data validation, monitoring, and error handling mechanisms.
- Performance Optimization: Optimize data workflows for performance, reliability, and scalability to meet business and technical requirements.
- Collaboration: Collaborate with data scientists, analysts, and other stakeholders to ensure data flows meet their processing and analytical needs.
- Continuous Improvement: Stay updated with the latest big data technologies and best practices, and implement improvements in data processing pipelines.
- Collaborate with data scientists, analysts, and business stakeholders to align data pipelines with business needs.
- Work with third-party vendors or consultants related to ETL tools, big data technologies, or platform services.
Requirements
- Education: Bachelor’s degree in computer science, Data Engineering, or a related field.
- Experience (3-5 years): Proven experience with data engineering and building scalable data pipelines for data transformation, integration, and storage.
- Technical Skills: Proficiency in programming languages such as Python, SQL, or Java. Experience with big data technologies like Spark, Hadoop, and familiarity with ETL tools like SSIS and Informatica.
- Soft Skills: Strong problem-solving, analytical, and communication skills, with the ability to collaborate across teams.
- Expertise in building and maintaining scalable data pipelines and architectures.
- Proficient in Python, SQL, Java, and big data tools such as Spark and Hadoop.
- Experience with ETL tools (SSIS, Informatica) and managing data integration processes. Develop and optimize ETL/ELT processes using (Informatica BDM , SSIS , IDQ ..etc)
- Strong understanding of data integrity, quality, and security BDM, SSIS, Ability to optimize workflows for performance and reliability.
Skills Required
- Bachelor's degree in Computer Science, Data Engineering, or a related field
- 3-5 years of experience in data engineering and building scalable data pipelines
- Proficiency in Python, SQL, or Java
- Experience with big data technologies such as Spark and Hadoop
- Experience with ETL tools including SSIS and Informatica
- Experience managing data integration processes and developing ETL/ELT workflows
- Understanding of data integrity, quality, and security
- Strong problem-solving, analytical, and communication skills
- Ability to collaborate across teams and with third-party vendors or consultants
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
MigrationIT is a Cairo-based IT recruitment and workforce-services company. It recruits IT professionals and offers outsourcing and temporary hiring, alongside IT consulting and project management. Its managed IT services help organizations manage their systems and assets through consultants, service-desk agents, and partners. The company focuses on matching employers with technology talent while supporting IT projects and day-to-day operations across a range of business environments.








