The Role
Design, develop, and optimize enterprise-scale data platforms, pipelines, data lakes, warehouses, and analytical datasets on Azure and Snowflake. Build ETL/ELT processes using ADF, Databricks, PySpark, SQL, Python, and Snowflake. Manage data models, governance, security, quality, CI/CD, cloud migrations, and performance optimization. Collaborate with stakeholders, troubleshoot production issues, document solutions, and support Agile delivery.
Summary Generated by Built In
- Azure Data Engineer with 6+ years of experience designing, developing, and optimizing enterprise-scale data platforms using Microsoft Azure and Snowflake
- Proven expertise in building scalable data pipelines, data warehouses, and analytics solutions leveraging Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Snowflake, Python, SQL, and Spark
- Experienced in data modeling, ETL/ELT development, cloud migration, performance tuning, data governance, and implementing CI/CD practices
- Strong background in integrating data from multiple sources and enabling business intelligence and advanced analytics solutions
Key Skills: - Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Snowflake Data Cloud
- Python, PySpark, SQL
- Azure Data Lake Storage (ADLS Gen2)
- Azure Functions
- Delta Lake
- Data Warehousing & Data Modeling
- ETL / ELT Development
- CI/CD (Azure DevOps, Git)
- Performance Tuning & Optimization
- Data Governance & Security
- Power BI Integration
- Agile & Scrum Methodologies
What you will do:
- Design, develop, and maintain scalable data engineering solutions on Azure and Snowflake platforms
- Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake to ingest, transform, and load data from various structured and unstructured sources
- Develop and maintain enterprise data warehouses, data marts, and analytical datasets supporting reporting, BI, and advanced analytics initiatives
Implement data transformation and orchestration processes using PySpark, SQL, Python, and Snowflake stored procedures - Design and manage cloud-based data lakes using Azure Data Lake Storage (ADLS Gen2) and Delta Lake architecture
- Collaborate with business stakeholders, data analysts, and architects to gather requirements and translate them into scalable data solutions
- Monitor and optimize data pipeline performance, ensuring reliability, scalability, and cost efficiency
- Implement data quality frameworks, validation rules, and monitoring processes to ensure accurate and trusted data
- Manage Snowflake objects including databases, schemas, warehouses, tasks, streams, and data-sharing capabilities
- Develop and maintain dimensional and normalized data models following industry best practices
- Implement security controls, access management, encryption, and governance policies across Azure and Snowflake environments
- Support cloud migration and modernization initiatives from on-premises or legacy platforms to Azure and Snowflake
- Automate deployment processes using Azure DevOps, Git repositories, and CI/CD pipelines
- Troubleshoot production issues, perform root cause analysis, and provide timely resolution for data-related challenges
- Participate in Agile ceremonies, code reviews, and technical design discussions to ensure high-quality solution delivery
- Create technical documentation, architecture diagrams, operational runbooks, and knowledge-transfer materials
Preferred Certifications: - Microsoft Certified: Azure Data Engineer Associate (DP-203)
- SnowPro Core Certification
Skills Required
- 6+ years of experience designing, developing, and optimizing enterprise-scale data platforms
- Experience with Microsoft Azure and Snowflake
- Expertise with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Python, SQL, and Spark
- Experience building scalable data pipelines, data warehouses, and analytics solutions
- Experience with data modeling, ETL/ELT development, cloud migration, performance tuning, data governance, and CI/CD
- Experience with Azure Data Lake Storage Gen2, Azure Functions, Delta Lake, Azure DevOps, Git, and Power BI integration
- Experience implementing data quality frameworks, security controls, access management, encryption, and governance policies
- Experience managing Snowflake databases, schemas, warehouses, tasks, streams, and data-sharing capabilities
- Experience with Agile and Scrum methodologies
- Microsoft Certified: Azure Data Engineer Associate certification DP-203
- SnowPro Core Certification
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
A premiere data services company serving clients in North America, Datavail has 1,000 data professionals, data engineers, developers, project managers, consultants, and business experts, supported by industry-leading automation and intellectual property. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes. At Datavail, we look for more than smarts, experience and proficiency. On top of those requirements, we seek people who mesh with our corporate values. We seek brilliance without bravado and know-how without a know-it-all attitude. We hold low ego in high regard, embrace problem-solving as a passion and welcome every day as a new opportunity to learn. We’re flexible and hard working. We’re committed to our clients and colleagues. We help our people grow so they can help our clients grow. That makes us grow so we can help even more customers leverage organizational data for business value. Our Core Values: 1. We desire to serve. 2. We embody flexibility for availability 3. We exemplify low ego. 4. We work hard. 5. We strive for continuous improvement. 6. We are growth-oriented.
.png)
.png)
