Data Quality Engineer – Azure Data Platform Testing
Overview
Seeking a seasoned Azure Data Engineer Tester to drive test strategy and ensure data quality across a large-scale Azure data platform modernization initiative. Data is a critical enterprise asset, and this role ensures accurate ingestion, transformation, storage, and reporting across cloud-based data solutions. The ideal candidate has test lead experience, strong automation skills, Agile exposure, and familiarity with P&C insurance domains.
Key Responsibilities
Test Strategy & Leadership
- Drive overall test strategy and create effective test cases and scenarios based on business and user requirements
- Define and implement test automation strategy, ensuring the right balance of manual and automated testing
- Participate in architecture, design, requirements, and code reviews; provide feedback to stakeholders
Azure Data Pipeline Testing
- Test Azure data pipelines built using services such as Microsoft Azure, Azure Data Factory, and Azure Synapse Analytics
- Validate end-to-end data movement from source to destination across batch and streaming workflows
Ensure Data Quality & Accuracy
- Validate ETL/ELT transformations across Medallion architecture layers
- Identify missing, duplicate, or incorrect data and ensure business rules are applied accurately
- Validate analytical outputs such as dashboards, reports, and data visualizations
Database & Storage Validation
- Test data stored in Azure SQL Database and Azure Data Lake Storage for integrity, reliability, and performance
- Validate schema, source-to-target mappings, and data models
Automation & Performance Testing
- Develop automated test scripts using SQL, Python, and PySpark
- Perform performance, scalability, and load testing of pipelines and data platforms
- Track defects and test cycles using Jira
Desired Skills & Competencies
Data & Technical Acumen
- Strong understanding of data warehousing concepts, star schemas, data marts, and Medallion architecture
- Ability to read data models and update source-to-target mapping documents
- Hands-on experience with Snowflake, Azure, DBT, Python, and PySpark
Industry & Methodology
- Experience working in Agile environments
- Knowledge of Property & Casualty (P&C) and Specialty Insurance is preferred
Key Responsibilities
Test Strategy & Leadership
- Drive overall test strategy and create effective test cases and scenarios based on business and user requirements
- Define and implement test automation strategy, ensuring the right balance of manual and automated testing
- Participate in architecture, design, requirements, and code reviews; provide feedback to stakeholders
Azure Data Pipeline Testing
- Test Azure data pipelines built using services such as Microsoft Azure, Azure Data Factory, and Azure Synapse Analytics
- Validate end-to-end data movement from source to destination across batch and streaming workflows
Ensure Data Quality & Accuracy
- Validate ETL/ELT transformations across Medallion architecture layers
- Identify missing, duplicate, or incorrect data and ensure business rules are applied accurately
- Validate analytical outputs such as dashboards, reports, and data visualizations
Database & Storage Validation
- Test data stored in Azure SQL Database and Azure Data Lake Storage for integrity, reliability, and performance
- Validate schema, source-to-target mappings, and data models
Automation & Performance Testing
- Develop automated test scripts using SQL, Python, and PySpark
- Perform performance, scalability, and load testing of pipelines and data platforms
- Track defects and test cycles using Jira
Bachelors Degree
Skills Required
- Bachelor's Degree
- Test lead / test strategy experience
- Strong automation skills (develop automated test scripts)
- Experience in Agile environments
- Hands-on experience with Python
- Hands-on experience with PySpark
- Strong SQL skills
- Experience with Microsoft Azure
- Experience with Azure Data Factory
- Experience with Azure Synapse Analytics
- Experience with Azure SQL Database
- Experience with Azure Data Lake Storage
- Hands-on experience with Snowflake
- Experience with DBT
- Experience validating ETL/ELT transformations and Medallion architecture
- Performance, scalability, and load testing of data pipelines
- Experience using Jira for defect and test cycle tracking
- Familiarity with Property & Casualty (P&C) insurance
What We Do
Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.
