The Role
Design, build, and maintain scalable ETL/ELT pipelines on Azure using ADF, Databricks (PySpark), and Python. Optimize SQL, enforce data quality and monitoring, implement CI/CD with Azure DevOps, and deploy Azure infrastructure via Bicep while ensuring security and governance.
Summary Generated by Built In
As a Senior Azure Data Engineer, you will:
- Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory (ADF).
- Build and optimize data transformation workflows using Azure Databricks (PySpark) and Python.
- Develop and fine-tune SQL queries, stored procedures, and views for high-volume data platforms.
- Implement data quality frameworks, monitoring, and logging mechanisms across data pipelines.
- Establish and manage CI/CD pipelines for data solutions using Azure DevOps.
- Handle deployment automation for ADF pipelines, Databricks notebooks, and database scripts.
- Manage version control, branching strategies, and environment configuration across development lifecycles.
- Deploy and maintain Azure infrastructure components such as Azure SQL, Event Grid, Virtual Networks (VNet), Private Endpoints (PEP), Key Vaults, and related services using Bicep.
- Ensure adherence to security, governance, and compliance standards across data platforms.
What You Bring to the Table:
- 6–8 years of overall experience in Data Engineering or related roles.
- Strong hands-on expertise in Azure Data Factory, Azure Databricks, and PySpark.
- Proficiency in Python programming for data processing and automation.
- Advanced knowledge of SQL performance tuning and data modeling.
- Experience implementing DevOps practices in data engineering environments using Azure DevOps.
- Solid understanding of Azure cloud infrastructure and Infrastructure as Code using Bicep.
- Experience working with enterprise-scale data ingestion, transformation, and orchestration.
- Familiarity with data governance, security best practices, and compliance frameworks.
You Should Possess the Ability To:
- Design and implement high-performance, scalable, and reliable data pipelines.
- Troubleshoot, optimize, and enhance data workflows for performance and cost efficiency.
- Collaborate with cross-functional teams including analytics, application development, and infrastructure teams.
- Automate deployments and enforce best practices for code versioning and release management.
- Translate business and technical requirements into robust data engineering solutions.
- Ensure strong documentation, monitoring, and operational support for data platforms.
What We Bring to the Table:
- Opportunities to work on large-scale, cloud-based data transformation initiatives.
- Exposure to modern Azure data and analytics ecosystem.
- A collaborative environment focused on innovation, automation, and continuous improvement.
- Opportunities to contribute to architecture design and next-generation data platform development.
- A learning-driven culture encouraging adoption of emerging cloud and data engineering technologies.
Let’s Connect
Want to discuss this opportunity in more detail? Feel free to reach out.
Recruiter: Aswin Dhanvandhar
Phone: +31 20 369 0609 ; Extn :141
LinkedIn:https://www.linkedin.com/in/aswin-dhanvandhar/
Skills Required
- 6-8 years overall experience in Data Engineering or related roles.
- Hands-on expertise with Azure Data Factory (ADF).
- Experience with Azure Databricks and PySpark.
- Proficiency in Python for data processing and automation.
- Advanced SQL skills including performance tuning, stored procedures, views, and data modeling.
- Experience implementing DevOps practices and CI/CD for data solutions using Azure DevOps.
- Experience with Infrastructure as Code using Bicep.
- Experience deploying and managing Azure services: Azure SQL, Event Grid, Virtual Networks, Private Endpoints, and Key Vaults.
- Experience with enterprise-scale data ingestion, transformation, and orchestration.
- Familiarity with data governance, security best practices, and compliance frameworks.
- Experience with version control, branching strategies, and release management.
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
STAFIDE is a Netherlands-based niche technology talent consulting company operating across Europe. It helps organizations identify, recruit, and deploy technology professionals in areas including cybersecurity, cloud engineering, software development, data analytics, ERP, infrastructure, and digital transformation. Its services include recruitment, workforce engagement, secondment, onboarding support, workforce deployment, and workforce analytics that support technology hiring and expansion.
.jpg)
