Be an Early Applicant
Award winning experts in eCommerce! We have more than ten years of experience with eCommerce solutions.
The Role
Designs and owns scalable Azure-based data platforms, including enterprise data warehouses, ETL/ELT pipelines, PySpark and Delta Lake transformations, dimensional models, and Power BI analytics. The role also covers data quality, reconciliation, financial reporting logic, API ingestion, performance optimization, CI/CD, stakeholder collaboration, architecture best practices, and mentoring junior engineers.
Summary Generated by Built In
Senior Data Engineer
Location - India (Coimbatore preferred)
Work Mode - WFO preferred, hybrid or remote will also be considered for the right candidate
Experience - 5+ years in Data Engineering, including hands-on cloud data platform delivery
Employment Type - Full-Time
ROLE OVERVIEW
Vserve is looking for a Senior Data Engineer to design, build, and own scalable data platforms on Microsoft Azure
ecosystems. This role will lead the development of Enterprise Data Warehousing, ETL/ELT pipelines, and analytics-
ready data models that power reporting and decision-making for our retail, wholesale, and distribution clients. The
ideal candidate is equally comfortable architecting cloud-native pipelines and partnering directly with business
stakeholders to translate requirements into reliable, production-grade data solutions.
KEY RESPONSIBILITIES
• Design, build, and maintain scalable Enterprise Data Warehouse (EDW) solutions on Azure (ADF, Databricks, Azure SQL, Microsoft Fabric).
• Develop and orchestrate end-to-end ETL/ELT pipelines using Apache Airflow, Azure Data Factory, and Databricks, ensuring reliability and minimal manual intervention.
• Build and optimize PySpark transformations and Delta Lake pipelines to process large-scale datasets into curated, analytics-ready data products.
• Design dimensional data models (star/snowflake schemas), fact and dimension tables, and data marts to support sales, inventory, demand, and profitability reporting.
• Develop Power BI semantic models, datasets, and interactive dashboards enabling self-service analytics and KPI reporting for business stakeholders.
• Implement data quality and validation frameworks, including reconciliation checks, exception reporting, and automated alerting.
• Own data reconciliation between ERP/business systems (e.g., Microsoft Dynamics AX / D365 F&O, POS platforms) and the enterprise data warehouse.
• Implement complex business logic for margin calculations, cost attribution, and promotional/discount allocation to
support accurate financial reporting.
• Build automated data ingestion frameworks using Python and REST APIs, and implement incremental loading
strategies for efficient, near real-time reporting.
• Tune and optimize SQL/PL-SQL queries and data workflows for performance across high-volume, regulated, or
compliance-sensitive datasets.
• Implement CI/CD for data pipelines (GitHub Actions, Git) to improve release consistency and reduce deployment
effort.
• Partner with business users, analysts, and SMEs to gather requirements and translate them into scalable, well-
documented data engineering solutions.
• Mentor junior data engineers and contribute to data architecture and engineering best practices across the team.
CANDIDATE PROFILE — SKILLS & EXPERIENCE
Must-Have
• 5+ years of hands-on Data Engineering experience, with demonstrated ownership of production data pipelines
end to end.
• Strong experience with Microsoft Azure data services: Azure Data Factory (ADF), Databricks, Azure Data
Lake, Azure SQL.
• Hands-on expertise in Apache Spark / PySpark and Delta Lake for large-scale data processing.
• Proven experience building and orchestrating pipelines with Apache Airflow or equivalent workflow
orchestration tools.
• Advanced SQL skills and solid Python (Pandas, NumPy) programming ability.
• Strong grounding in dimensional data modeling (star/snowflake schemas, normalization, ER-diagram design).
• Experience with Power BI (DAX, Power Query) and/or Microsoft Fabric for reporting and dashboard delivery.
• Experience implementing data quality, validation, and reconciliation frameworks in a production
environment.
Good-to-Have
• Exposure to Microsoft Dynamics AX / Dynamics 365 Finance & Operations (D365 F&O) or similar ERP/POS
platforms (e.g., Aptos POS).
• Experience with Informatica PowerCenter or other enterprise ETL tools.
• Familiarity with MongoDB, PostgreSQL, or DynamoDB alongside relational/warehouse platforms.
• Experience in retail, wholesale distribution, or financial services data domains.
• Working knowledge of CI/CD practices (GitHub Actions, Git) and Agile delivery methodologies.
• Prior experience mentoring engineers or leading a small data engineering pod.
Education
• Bachelor degree in Computer Science, Information Technology, or a related field is required.
• Master degree is a plus.
Requirements
Azure, ADF, Databricks, PySpark, Python, SQL, Airflow, Delta Lake, ETL/ELT, Data Warehousing, Data Modeling, Power BI, DAX, Data Quality, REST API, Git/CI-CD, D365 F&O
Skills Required
- 5+ years of hands-on data engineering experience, including ownership of production data pipelines
- Experience with Azure Data Factory, Databricks, Azure Data Lake, and Azure SQL
- Hands-on Apache Spark, PySpark, and Delta Lake experience
- Experience building and orchestrating pipelines with Apache Airflow or equivalent tools
- Advanced SQL skills and solid Python programming ability, including Pandas and NumPy
- Experience with dimensional data modeling, star and snowflake schemas, normalization, and ER diagrams
- Experience with Power BI, DAX, Power Query, and/or Microsoft Fabric
- Experience implementing production data quality, validation, and reconciliation frameworks
- Bachelor's degree in Computer Science, Information Technology, or a related field
- Exposure to Microsoft Dynamics AX, Dynamics 365 Finance and Operations, or similar ERP/POS platforms
- Experience with Informatica PowerCenter or other enterprise ETL tools
- Familiarity with MongoDB, PostgreSQL, or DynamoDB
- Experience in retail, wholesale distribution, or financial services data domains
- Working knowledge of GitHub Actions, Git, CI/CD, and Agile delivery methodologies
- Experience mentoring engineers or leading a small data engineering pod
- Master's degree
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
At Vserve, we are award winning eCommerce specialists! Vserve is one of the leading full-service ecommerce agencies that offers a range of ebusiness solutions, catalog management services, and business intelligence expertise. In short, we specialize in delivering customized ecommerce solutions that make your business work for you so that you can work less!
Gallery
