The Role
Leads the design, development, and delivery of Azure-based data engineering solutions using Azure Data Factory, Azure Data Lake, Snowflake, dbt, and SQL. Integrates Guidewire and insurance data into enterprise platforms, oversees pipeline performance and reliability, establishes data quality and governance standards, supports cloud migration, and provides technical leadership to data engineering teams and stakeholders.
Summary Generated by Built In
Job Description: Azure Lead Data Engineer + Guidewire Role Overview
We are seeking an experienced Azure Lead Data Engineer with Guidewire expertise to lead the design, development, and delivery of scalable data engineering solutions for insurance and enterprise data platforms. The ideal candidate will have strong hands-on experience with Azure Data Factory (ADF), Azure Data Lake, Snowflake, DBT, SQL, and cloud-based data integration, along with a solid understanding of Guidewire InsuranceSuite data and integrations.
The candidate will provide technical leadership, work closely with business and technology stakeholders, and ensure the delivery of reliable, high-performance, and governed data pipelines.
Key Responsibilities
- Lead the design and development of scalable ETL/ELT data pipelines using Azure Data Factory, Snowflake, DBT, and other Azure data services.
- Design and manage data integration workflows from multiple source systems, including Guidewire applications and insurance data platforms, into Snowflake and Azure-based data environments.
- Analyze and understand Guidewire data models, business entities, policy, claims, billing, underwriting, and related insurance datasets.
- Develop efficient and optimized SQL queries for data extraction, transformation, validation, and reporting.
- Lead technical discussions with business stakeholders, Guidewire teams, architects, and data consumers to translate business requirements into scalable technical solutions.
- Provide technical leadership and guidance to data engineering team members and review code, data models, and pipeline designs.
- Monitor, troubleshoot, and optimize data pipelines to ensure high performance, reliability, scalability, and availability.
- Implement and enforce data quality, governance, metadata, lineage, and documentation standards.
- Develop and maintain reusable data engineering frameworks and best practices.
- Collaborate with data architects, analysts, DevOps, QA, and cloud engineering teams in a cloud-native environment.
- Support migration and modernization of legacy insurance data platforms into Azure and Snowflake.
- Implement and support CI/CD processes for data engineering workflows.
- Ensure data solutions comply with enterprise security, governance, and regulatory requirements.
Must-Have Skills
- 8+ years of experience in Data Engineering, Data Integration, or related roles.
- Strong hands-on experience with the Azure Cloud Platform and Azure data services.
- Proven expertise in Azure Data Factory (ADF) for designing, orchestrating, automating, and monitoring complex data pipelines.
- Strong experience with Azure Data Lake Storage (ADLS) and cloud-based data integration architectures.
- Extensive experience with SQL, including complex queries, performance optimization, and data transformation.
- Hands-on experience with Snowflake and SnowSQL for cloud data warehousing and data engineering.
- Strong working knowledge of DBT (Data Build Tool) for data transformation, testing, and documentation.
- Experience working with large-scale and complex enterprise datasets.
- Strong understanding of Guidewire InsuranceSuite, Guidewire data models, or Guidewire-based data integrations.
- Experience working with insurance domain data such as Policy, Claims, Billing, Customer, Producer, and Underwriting data.
- Strong problem-solving, communication, stakeholder management, and technical leadership skills.
Guidewire-Specific Requirements
- Experience integrating data from Guidewire applications into enterprise data platforms.
- Strong understanding of Guidewire data structures and insurance business processes.
- Experience with Guidewire PolicyCenter, ClaimCenter, and/or BillingCenter data is highly preferred.
- Ability to work with Guidewire APIs, extracts, events, or integration mechanisms where applicable.
- Experience in designing downstream data pipelines and analytics solutions for Guidewire-generated data.
- Understanding of insurance data governance, reconciliation, and data quality requirements.
Good-to-Have Skills
- Experience with Azure Synapse Analytics.
- Experience with Azure Functions.
- Knowledge of Python and/or PySpark for custom data transformations and engineering solutions.
- Experience with Databricks is an added advantage.
- Experience with legacy technologies such as DataStage or Netezza.
- Strong understanding of CI/CD pipelines and DevOps practices for data workflows.
- Experience with data governance, metadata management, data catalog, and data lineage tools.
- Exposure to Power BI, Tableau, or other BI and analytics tools.
- Experience in insurance industry data modernization and cloud migration projects.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
- 8+ years of experience in Data Engineering with strong exposure to Azure and cloud data platforms.
- Demonstrated experience leading data engineering teams or providing technical leadership on enterprise data projects.
- Strong understanding of modern cloud data architecture, ETL/ELT, data warehousing, and data governance.
- Excellent communication and collaboration skills with the ability to work across business and technical teams.
Responsibilities
Key Responsibilities
- Lead the design and development of scalable ETL/ELT data pipelines using Azure Data Factory, Snowflake, DBT, and other Azure data services.
- Design and manage data integration workflows from multiple source systems, including Guidewire applications and insurance data platforms, into Snowflake and Azure-based data environments.
- Analyze and understand Guidewire data models, business entities, policy, claims, billing, underwriting, and related insurance datasets.
- Develop efficient and optimized SQL queries for data extraction, transformation, validation, and reporting.
- Lead technical discussions with business stakeholders, Guidewire teams, architects, and data consumers to translate business requirements into scalable technical solutions.
- Provide technical leadership and guidance to data engineering team members and review code, data models, and pipeline designs.
- Monitor, troubleshoot, and optimize data pipelines to ensure high performance, reliability, scalability, and availability.
- Implement and enforce data quality, governance, metadata, lineage, and documentation standards.
- Develop and maintain reusable data engineering frameworks and best practices.
- Collaborate with data architects, analysts, DevOps, QA, and cloud engineering teams in a cloud-native environment.
- Support migration and modernization of legacy insurance data platforms into Azure and Snowflake.
- Implement and support CI/CD processes for data engineering workflows.
- Ensure data solutions comply with enterprise security, governance, and regulatory requirements.
Must-Have Skills
- 8+ years of experience in Data Engineering, Data Integration, or related roles.
- Strong hands-on experience with the Azure Cloud Platform and Azure data services.
- Proven expertise in Azure Data Factory (ADF) for designing, orchestrating, automating, and monitoring complex data pipelines.
- Strong experience with Azure Data Lake Storage (ADLS) and cloud-based data integration architectures.
- Extensive experience with SQL, including complex queries, performance optimization, and data transformation.
- Hands-on experience with Snowflake and SnowSQL for cloud data warehousing and data engineering.
- Strong working knowledge of DBT (Data Build Tool) for data transformation, testing, and documentation.
- Experience working with large-scale and complex enterprise datasets.
- Strong understanding of Guidewire InsuranceSuite, Guidewire data models, or Guidewire-based data integrations.
- Experience working with insurance domain data such as Policy, Claims, Billing, Customer, Producer, and Underwriting data.
- Strong problem-solving, communication, stakeholder management, and technical leadership skills.
Guidewire-Specific Requirements
- Experience integrating data from Guidewire applications into enterprise data platforms.
- Strong understanding of Guidewire data structures and insurance business processes.
- Experience with Guidewire PolicyCenter, ClaimCenter, and/or BillingCenter data is highly preferred.
- Ability to work with Guidewire APIs, extracts, events, or integration mechanisms where applicable.
- Experience in designing downstream data pipelines and analytics solutions for Guidewire-generated data.
- Understanding of insurance data governance, reconciliation, and data quality requirements.
Good-to-Have Skills
- Experience with Azure Synapse Analytics.
- Experience with Azure Functions.
- Knowledge of Python and/or PySpark for custom data transformations and engineering solutions.
- Experience with Databricks is an added advantage.
- Experience with legacy technologies such as DataStage or Netezza.
- Strong understanding of CI/CD pipelines and DevOps practices for data workflows.
- Experience with data governance, metadata management, data catalog, and data lineage tools.
- Exposure to Power BI, Tableau, or other BI and analytics tools.
- Experience in insurance industry data modernization and cloud migration projects.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
- 8+ years of experience in Data Engineering with strong exposure to Azure and cloud data platforms.
- Demonstrated experience leading data engineering teams or providing technical leadership on enterprise data projects.
- Strong understanding of modern cloud data architecture, ETL/ELT, data warehousing, and data governance.
- Excellent communication and collaboration skills with the ability to work across business and technical teams.
Skills Required
- 8+ years of experience in data engineering, data integration, or related roles
- Hands-on experience with Azure Cloud Platform and Azure data services
- Expertise with Azure Data Factory for designing, orchestrating, automating, and monitoring complex data pipelines
- Experience with Azure Data Lake Storage and cloud-based data integration architectures
- Extensive SQL experience, including complex queries, performance optimization, and data transformation
- Hands-on experience with Snowflake and SnowSQL
- Working knowledge of dbt for data transformation, testing, and documentation
- Experience working with large-scale and complex enterprise datasets
- Strong understanding of Guidewire InsuranceSuite, Guidewire data models, or Guidewire-based data integrations
- Experience with insurance data such as policy, claims, billing, customer, producer, and underwriting data
- Strong problem-solving, communication, stakeholder management, and technical leadership skills
- Experience integrating Guidewire applications into enterprise data platforms
- Understanding of Guidewire data structures and insurance business processes
- Experience with Guidewire PolicyCenter, ClaimCenter, and/or BillingCenter
- Ability to work with Guidewire APIs, extracts, events, or integration mechanisms
- Experience designing downstream data pipelines and analytics solutions for Guidewire-generated data
- Understanding of insurance data governance, reconciliation, and data quality requirements
- Experience with Azure Synapse Analytics
- Experience with Azure Functions
- Knowledge of Python and/or PySpark for custom data transformations and engineering solutions
- Experience with Databricks
- Experience with DataStage or Netezza
- Understanding of CI/CD pipelines and DevOps practices for data workflows
- Experience with data governance, metadata management, data catalog, and data lineage tools
- Exposure to Power BI, Tableau, or other business intelligence and analytics tools
- Experience in insurance industry data modernization and cloud migration projects
- Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field
- Demonstrated experience leading data engineering teams or providing technical leadership on enterprise data projects
- Strong understanding of modern cloud data architecture, ETL/ELT, data warehousing, and data governance
- Excellent communication and collaboration skills across business and technical teams
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.
.png){kind=logo}
