The Role
Design and develop scalable Azure-based ETL and ELT pipelines using Azure Data Factory and Databricks. Build lakehouse solutions with ADLS Gen2, PySpark, Spark SQL, and Delta Lake. Integrate Synapse, Event Hub, Logic Apps, Functions, Azure SQL, Key Vault, and SharePoint. Troubleshoot and optimize data pipelines and Spark workloads while working UAE business hours and observing the UAE public holiday calendar.
Summary Generated by Built In
Experience: 5+ Years
Location: Hybrid – Pakistan
Working Hours: UAE Business Hours
We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.
Key Skills- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics
- Azure Event Hub
- Azure Data Lake Storage Gen2
- Azure Logic Apps & Function Apps
- Azure SQL Database
- Azure Key Vault
- Microsoft SharePoint Integration
- PySpark & Spark SQL
- Delta Lake & Delta Tables
- Data Lakehouse Architecture
- Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
- Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
- Build and maintain Data Lakehouse solutions using ADLS Gen2.
- Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
- Implement secure integrations using Azure Key Vault and SharePoint.
- Troubleshoot and optimize data pipelines and Spark workloads.
Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.
Skills Required
- 5+ years of hands-on experience designing and developing scalable data solutions on Microsoft Azure
- Experience with Azure Data Factory
- Experience with Azure Databricks
- Experience with Azure Synapse Analytics
- Experience with Azure Event Hub
- Experience with Azure Data Lake Storage Gen2
- Experience with Azure Logic Apps and Function Apps
- Experience with Azure SQL Database
- Experience with Azure Key Vault
- Experience integrating Microsoft SharePoint
- Proficiency with PySpark and Spark SQL
- Experience with Delta Lake and Delta Tables
- Experience with Data Lakehouse Architecture
- Comfort working UAE business hours and following the UAE public holiday calendar
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
NorthBay is an AWS Premier Partner focused on Database & Application migrations, data & analytics, DevOps & DataOps, application modernization and ML/Ai. Our practice areas include big data and analytics, machine learning, artificial intelligence and database migrations.
