The Role
Design and implement scalable Azure data solutions and end-to-end pipelines using Databricks, PySpark/Spark-SQL, ADLS and ADF. Migrate and ingest disparate sources, optimize Spark workloads, support DevOps/ARM deployments, implement serverless functions, manage pipelines, and contribute to governance with Unity Catalog while providing production support and stakeholder collaboration.
Summary Generated by Built In
As a Senior Azure Data Engineer, you will:
- Design and implement scalable data solutions based on high-level architecture.
- Build and optimize end-to-end data pipelines using Azure Databricks.
- Load and process data from disparate data sources into centralized platforms.
- Perform preprocessing, transformation, and enrichment using PySpark and Spark-SQL.
- Work directly with stakeholders to gather business requirements for data pipeline and lake migration initiatives.
- Develop and maintain data solutions using Azure services such as ADLS, ADF, Cosmos DB, and Azure SQL DW.
- Implement serverless architectures using Azure Functions.
- Monitor and manage Azure DevOps and Databricks pipelines.
- Participate in production support and incident resolution.
- Contribute to data governance practices using Unity Catalog.
- Support ARM template-based infrastructure deployments.
- Continuously improve pipeline performance, reliability, and scalability.
What You Bring to the Table:
- 8-10 years of hands-on experience in data engineering and Azure ecosystem.
- Strong expertise in Python and Scala for data processing.
- Deep knowledge of SQL and NoSQL databases.
- Advanced experience with PySpark and Spark-SQL.
- Strong hands-on experience with Azure Databricks.
- Practical experience with Azure Data Lake Storage (ADLS) and Azure Data Factory (ADF).
- Experience working with Stream Analytics, SQL Data Warehouse, and Cosmos DB.
- Experience deploying infrastructure using ARM Templates.
- Solid exposure to Azure DevOps practices.
- Experience handling large-scale distributed data systems.
You should possess the ability to:
- Design independent solutions from high-level architecture without constant supervision.
- Translate business requirements into technical data solutions.
- Handle complex data ingestion from multiple heterogeneous sources.
- Optimize Spark workloads for performance and cost efficiency.
- Monitor and troubleshoot production pipelines effectively.
- Collaborate cross-functionally with business and technical stakeholders.
- Implement data governance and access control using Unity Catalog.
- Automate deployments using DevOps and Infrastructure-as-Code practices.
What We Bring to the Table:
- Opportunity to work on large-scale Azure data transformation projects.
- Exposure to modern cloud-native and serverless architecture.
- Collaborative environment with cross-functional stakeholders.
- Ownership-driven culture where independent solution design is valued.
- Hands-on experience with enterprise-grade data platforms.
- Involvement in cloud migration and lakehouse implementations.
- Exposure to DevOps-driven data engineering practices.
Let's Connect!
Want to discuss this opportunity in more detail? Feel free to reach out.
Recruiter: Asha Krishnan
Phone: +31 20 369 0609 ; Extn :146
LinkedIn: https://www.linkedin.com/in/asha-krishnan
Skills Required
- 8-10 years hands-on data engineering experience in Azure ecosystem
- Strong expertise in Python
- Strong expertise in Scala
- Advanced experience with PySpark and Spark-SQL
- Strong hands-on experience with Azure Databricks
- Practical experience with Azure Data Lake Storage (ADLS) and Azure Data Factory (ADF)
- Experience with Stream Analytics, Azure SQL Data Warehouse and Cosmos DB
- Experience deploying infrastructure using ARM Templates
- Solid exposure to Azure DevOps practices and pipeline management
- Experience handling large-scale distributed data systems
- Experience implementing serverless architectures using Azure Functions and contributing to data governance (Unity Catalog)
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
STAFIDE is a Netherlands-based niche technology talent consulting company operating across Europe. It helps organizations identify, recruit, and deploy technology professionals in areas including cybersecurity, cloud engineering, software development, data analytics, ERP, infrastructure, and digital transformation. Its services include recruitment, workforce engagement, secondment, onboarding support, workforce deployment, and workforce analytics that support technology hiring and expansion.
.jpg)
