The Role
Design and develop scalable Azure ETL and ELT pipelines using Azure Data Factory and Databricks. Build lakehouse solutions on ADLS Gen2, transform data with PySpark, Spark SQL, and Delta Lake, and integrate Synapse, Event Hubs, Logic Apps, Functions, Azure SQL, Key Vault, and SharePoint. Troubleshoot and optimize pipelines and Spark workloads while working UAE business hours and observing the UAE public holiday calendar.
Summary Generated by Built In
Experience: 5+ Years
Location: Hybrid – Pakistan
Working Hours: UAE Business Hours
We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.
Key Skills- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics
- Azure Event Hub
- Azure Data Lake Storage Gen2
- Azure Logic Apps & Function Apps
- Azure SQL Database
- Azure Key Vault
- Microsoft SharePoint Integration
- PySpark & Spark SQL
- Delta Lake & Delta Tables
- Data Lakehouse Architecture
- Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
- Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
- Build and maintain Data Lakehouse solutions using ADLS Gen2.
- Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
- Implement secure integrations using Azure Key Vault and SharePoint.
- Troubleshoot and optimize data pipelines and Spark workloads.
Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.
Skills Required
- 5+ years of hands-on experience designing and developing scalable data solutions on Microsoft Azure
- Experience with Azure Data Factory and Azure Databricks for ETL and ELT pipeline development
- Experience with PySpark, Spark SQL, Delta Lake, and Delta Tables
- Experience building Data Lakehouse solutions using Azure Data Lake Storage Gen2
- Experience with Azure Synapse Analytics, Azure Event Hubs, Logic Apps, Function Apps, and Azure SQL Database
- Experience implementing secure integrations with Azure Key Vault and Microsoft SharePoint
- Ability to troubleshoot and optimize data pipelines and Spark workloads
- Comfort working in UAE business hours and following the UAE public holiday calendar
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
NorthBay is an AWS Premier Partner focused on Database & Application migrations, data & analytics, DevOps & DataOps, application modernization and ML/Ai. Our practice areas include big data and analytics, machine learning, artificial intelligence and database migrations.
