The Role
Designs, develops, and maintains scalable Azure data pipelines and integrations. Uses Python, Azure Data Factory, Databricks, and Apache Spark for data ingestion, transformation, and processing. Monitors and optimizes pipeline performance, troubleshoots failures and data quality issues, and supports analytics and reporting requirements. Collaborates with technical and business stakeholders, follows development and testing standards, participates in Agile practices, and documents data solutions.
Summary Generated by Built In
As an Azure Data Engineer, you will
- Design, develop, and maintain scalable data pipelines using Microsoft Azure data services.
- Develop data processing and transformation solutions using Python.
- Build, configure, and manage data workflows using Azure Data Factory (ADF).
- Develop and optimize data processing solutions using Azure Databricks and Apache Spark.
- Integrate data from multiple sources using APIs and other data integration techniques.
- Work with Azure Databricks and Azure data services to process, transform, and prepare data for analytics and reporting.
- Implement data ingestion, transformation, and loading processes to support business requirements.
- Monitor data pipelines, troubleshoot failures, and resolve data processing issues.
- Optimize pipeline performance, reliability, and scalability.
- Collaborate with cross-functional teams to understand data requirements and deliver effective technical solutions.
- Follow coding standards, version control practices, testing procedures, and Agile ways of working.
- Maintain technical documentation and support data platform improvements.
What You Bring to the Table
- 4–6 years of professional experience in data engineering, Azure data solutions, or related technical roles.
- Hands-on experience with Microsoft Azure data engineering services.
- Strong programming knowledge in Python for data processing and transformation.
- Experience developing and maintaining data pipelines using Azure Data Factory.
- Practical experience with Azure Databricks and Apache Spark.
- Experience integrating data from external systems using APIs.
- Understanding of data ingestion, transformation, ETL/ELT processes, and data integration concepts.
- Knowledge of data pipeline monitoring, troubleshooting, and performance optimization.
- Familiarity with Agile methodologies and collaborative development practices.
- Strong analytical, problem-solving, and communication skills.
You Should Possess the Ability to :
- Develop reliable and scalable data pipelines using Python, Azure Data Factory, and Azure Databricks.
- Extract, transform, and load data from different sources into target data platforms.
- Build API-based integrations to ingest data from external applications and systems.
- Process and transform large datasets using Databricks and Spark.
- Troubleshoot pipeline failures, data quality issues, and performance bottlenecks.
- Optimize data processing workflows to improve performance and reliability.
- Collaborate with technical teams and business stakeholders to translate requirements into data engineering solutions.
- Follow established development standards and participate in Agile development activities.
- Document data pipelines, integration processes, and technical solutions.
What We Bring to the Table
- An opportunity to work on Azure-based data engineering projects.
- Exposure to Python development, cloud data integration, and large-scale data processing.
- Opportunities to contribute to data pipeline development and optimization.
- Collaboration with technical teams in an Agile working environment.
Let’s Connect
Want to discuss this opportunity in more detail? Feel free to reach out.
Recruiter: Giftson Paul Davidson
Phone: +31 20 369 0609 ; Extn : 151
LinkedIn: https://www.linkedin.com/in/giftsonpauldavidson/
Skills Required
- 4-6 years of professional experience in data engineering, Azure data solutions, or related technical roles
- Hands-on experience with Microsoft Azure data engineering services
- Strong programming knowledge in Python for data processing and transformation
- Experience developing and maintaining data pipelines using Azure Data Factory
- Practical experience with Azure Databricks and Apache Spark
- Experience integrating data from external systems using APIs
- Understanding of data ingestion, transformation, ETL/ELT processes, and data integration concepts
- Knowledge of data pipeline monitoring, troubleshooting, and performance optimization
- Familiarity with Agile methodologies and collaborative development practices
- Strong analytical, problem-solving, and communication skills
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
STAFIDE is a Netherlands-based niche technology talent consulting company operating across Europe. It helps organizations identify, recruit, and deploy technology professionals in areas including cybersecurity, cloud engineering, software development, data analytics, ERP, infrastructure, and digital transformation. Its services include recruitment, workforce engagement, secondment, onboarding support, workforce deployment, and workforce analytics that support technology hiring and expansion.
