Sr Data Engineer

We are looking for a Senior Data Engineer with strong expertise in Azure Data Engineering to design, build, automate, and maintain scalable data pipelines supporting Machine Learning and Analytics initiatives.

The ideal candidate will have hands-on experience with Azure-based data platforms, data pipeline automation, dataset management, data quality, and enterprise data engineering practices. The role requires close collaboration with Data Scientists, ML Engineers, and regional teams to ensure reliable data availability, efficient data refresh cycles, and operational excellence across production data pipelines.

• Design, develop, and automate scalable data pipelines for dynamic and frequently changing datasets.
  
• Build robust data workflows to support Machine Learning and Analytics use cases.
  
• Optimize data compilation and processing workflows to improve data refresh frequency and efficiency.
  
• Ensure reliable and timely availability of data for downstream applications and stakeholders.
  

• Compile, prepare, and manage datasets required for ML models and analytical initiatives.
  
• Develop processes to support timely dataset refresh requests.
  
• Generate and maintain model datasets using the latest available data based on business and stakeholder requirements.
  
• Ensure datasets meet required standards for accuracy, completeness, and usability.
  

• Perform data cleansing, validation, and quality checks across critical datasets.
  
• Identify and resolve data inconsistencies and quality issues.
  
• Maintain high standards of data accuracy, especially for high-priority ML and analytics projects.
  

• Support model monitoring activities to identify model drift and performance-related issues.
  
• Assist in setting up monitoring mechanisms for production models.
  
• Track and report model performance and monitoring metrics.
  
• Help establish processes and documentation for ongoing model monitoring.
  

• Collaborate closely with Data Scientists, ML Engineers, and regional teams.
  
• Work with regional teams to transition model monitoring and operational responsibilities.
  
• Establish clear processes, documentation, and regular monitoring cadences to ensure smooth handovers.
  

• Take ownership of assigned data engineering activities and deliverables.
  
• Ensure production data pipelines operate reliably and efficiently.
  
• Support high-priority projects with strong attention to detail and timely execution.
  
• Contribute to continuous improvement of data engineering processes and operational practices.
  

• Strong hands-on experience in Azure Data Engineering.
  
• Proven experience in developing and automating data pipelines.
  
• Experience working with Azure-based data platforms.
  
• Strong understanding of data preparation, data cleansing, and data quality management.
  
• Experience in managing and refreshing datasets for Machine Learning and Analytics use cases.
  
• Ability to optimize data processing workflows for performance and efficiency.
  
• Strong understanding of enterprise data engineering best practices.
  
• Experience collaborating with Data Scientists, ML Engineers, and cross-functional/regional teams.
  
• Strong analytical, problem-solving, and communication skills.
  

• Experience with model monitoring and identifying model drift.
  
• Knowledge of production model performance monitoring and reporting.
  
• Experience establishing monitoring processes and operational handovers.
  
• Exposure to Machine Learning and model lifecycle management.
  

As a Senior Data Engineer, you will play a key role in ensuring that high-quality, reliable, and up-to-date data is continuously available for ML and Analytics initiatives. You will own critical data pipeline automation, dataset management, data quality, and operational processes while working closely with technical and regional stakeholders.