The Role
Designs, develops, and maintains scalable Azure data platforms, including ETL/ELT pipelines, data lakes, warehouses, and medallion architectures. Integrates structured and unstructured data from diverse sources, optimizes SQL and Spark processing, and ensures data quality, governance, security, and compliance. Monitors production workflows, troubleshoots performance issues, and implements CI/CD and infrastructure automation while collaborating with analysts, DevOps teams, and business stakeholders.
Summary Generated by Built In
We are seeking a skilled Azure Data Engineer to design, develop, and maintain scalable cloud-based data solutions on the Microsoft Azure platform. The ideal candidate will have expertise in data integration, ETL/ELT pipelines, big data technologies, and cloud data warehousing to support analytics and business intelligence initiatives.
Key Responsibilities- Design and implement scalable data pipelines using Azure services.
- Develop and maintain ETL/ELT workflows for structured and unstructured data.
- Build and optimize data solutions using Azure cloud technologies.
- Integrate data from multiple sources including APIs, databases, flat files, and streaming platforms.
- Create and manage data lakes, data warehouses, and medallion architectures.
- Ensure data quality, governance, security, and compliance standards.
- Monitor and troubleshoot production data workflows and performance issues.
- Collaborate with data analysts, DevOps, and business stakeholders.
- Implement CI/CD pipelines and infrastructure automation for data platforms.
- Optimize SQL queries and improve overall data processing performance.
RequirementsTechnical Skills
- Strong experience with:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage (ADLS)
- Azure SQL Database
- Azure Functions
- Azure Event Hub / Service Bus
- Azure Data Factory (ADF)
- Proficiency in:
- SQL
- Python / PySpark
- Scala (optional)
- SQL
- Experience with:
- ETL/ELT pipeline development
- Data modeling and warehousing concepts
- Spark-based distributed processing
- REST APIs and data integration
- Git, CI/CD, and DevOps practices
- ETL/ELT pipeline development
Benefits
Standard Company Benefits
Skills Required
- Strong experience with Azure Data Factory
- Strong experience with Azure Databricks
- Strong experience with Azure Synapse Analytics
- Strong experience with Azure Data Lake Storage
- Strong experience with Azure SQL Database
- Strong experience with Azure Functions
- Strong experience with Azure Event Hubs or Service Bus
- Proficiency in SQL
- Proficiency in Python or PySpark
- Scala experience
- Experience developing ETL/ELT pipelines
- Experience with data modeling and data warehousing concepts
- Experience with Spark-based distributed processing
- Experience with REST APIs and data integration
- Experience with Git, CI/CD, and DevOps practices
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
DATAECONOMY is a global, cloud-first data and AI consultancy delivering enterprise-grade solutions through an innovative intellectual-property suite. Its work spans data and BI platform modernization, self-service AI, data mesh and fabric, master data management, governance, cloud enablement, digital engineering, knowledge graphs, and machine lakes supporting cybersecurity and financial-crime use cases for enterprise clients.
