Senior Data Engineer

Posted 2 Days Ago
4 Locations
In-Office
155K-160K Annually
Senior level
Insurance • Agriculture
The Role
Designs, develops, and supports enterprise data integration, ETL/ELT pipelines, Azure Synapse solutions, and data warehouse models. Responsibilities include migrating SSIS workloads to Azure, optimizing queries and pipelines, implementing data quality and monitoring frameworks, troubleshooting production issues, supporting governance and lineage, and managing source control and CI/CD deployments. The role collaborates with DBAs, application teams, analysts, reporting teams, and business stakeholders to deliver reliable, scalable data platforms.
Summary Generated by Built In

Job Description

Are you looking for your next opportunity?


Sompo has a unique opportunity for a Senior Data Engineer (SSIS & Azure Synapse) in our IT team.

 

We are seeking an experienced Senior Data Engineer to design, develop, and support enterprise-scale data integration and analytics solutions. The ideal candidate will have strong expertise in Microsoft SQL Server, SSIS, Azure Synapse Analytics, Azure Data Factory, and modern cloud-based data engineering practices. This role will be responsible for building reliable data pipelines, optimizing ETL/ELT processes, supporting data warehouse initiatives, and enabling business intelligence and analytics across the organization. The candidate will work closely with DBAs, application teams, business analysts, reporting teams, and other stakeholders to deliver scalable, reliable, and governed data solutions.


Location: This position will be based out of our Conshohocken, PA, Purchase, NY, Charlotte, NC or Morristown, NJ office. We strive for collaboration which is why we offer a work environment where our employees thrive and develop long lasting careers.


Our business, your impact, our opportunity:

What you’ll be doing:

  • Design, develop, maintain, and optimize enterprise ETL/ELT pipelines using SQL Server Integration Services, Azure Data Factory, and Synapse Pipelines for batch and near real-time data ingestion from internal and external systems.
  • Migrate legacy SSIS workloads to cloud-native Azure solutions where appropriate, ensuring scalable, reliable, and supportable data integration patterns.
  • Develop and support data solutions within Azure Synapse Analytics, including dedicated SQL pools, serverless SQL workloads, orchestration processes, workload optimization, and integration with Azure Data Lake Storage Gen2.
  • Design, implement, and maintain dimensional and relational data warehouse models, including fact tables, dimension tables, Star/Snowflake schemas, data marts, stored procedures, views, functions, and SQL scripts.
  • Build data solutions that support enterprise reporting, business intelligence, analytics, and downstream data consumption needs across the organization.
  • Implement data quality validations, reconciliation processes, exception handling, logging, monitoring, and alerting frameworks to improve pipeline reliability and operational transparency.
  • Optimize SQL queries, indexing, data models, partitioning strategies, pipeline performance, and data warehouse workloads to meet scalability and performance requirements.·         Troubleshoot production data pipeline failures, SQL performance issues, data quality issues, and data pipeline bottlenecks; perform root cause analysis and implement corrective and preventive solutions.
  • Collaborate with DBAs, application teams, business analysts, reporting teams, and other stakeholders to resolve data-related issues and deliver scalable, reliable, and governed data solutions.
  • Support enterprise data governance, metadata management, documentation, data lineage, operational procedures, knowledge sharing, and process discipline across data engineering initiatives.
  • Manage source control using Azure DevOps or Git, participate in CI/CD deployment processes, support release and environment migration activities, and automate recurring operational, deployment, and validation tasks.

What you’ll bring:

  • 10+ years of experience in data engineering, ETL/ELT development, and enterprise data warehousing, with strong hands-on expertise in Microsoft SQL Server, advanced T-SQL, SSIS, Azure Data Factory, Synapse Pipelines, performance tuning, query optimization, indexing, and production troubleshooting.
  • Proven experience designing, developing, optimizing, and supporting scalable Azure-based data platforms, including Azure Synapse Analytics, dedicated and serverless SQL workloads, Azure Data Lake Storage Gen2, cloud data ingestion, pipeline orchestration, and migration of legacy data workloads to cloud-native Azure solutions.
  • Strong background in dimensional and relational data modeling, including Star Schema, Snowflake Schema, fact and dimension tables, data marts, stored procedures, views, functions, SQL scripts, and data warehouse solutions supporting enterprise reporting, BI, and analytics.
  • Demonstrated ability to build and support reliable production data pipelines with data quality checks, validation, reconciliation, exception handling, logging, monitoring, alerting, root cause analysis, and operational support best practices.
  • Experience with Azure DevOps or Git, including source control, branching, code management, release management, CI/CD deployment processes, environment migrations, documentation, metadata management, data governance, and data lineage practices.
  • Strong analytical, problem-solving, communication, stakeholder management, and collaboration skills, with the ability to work independently, manage competing priorities, translate business requirements into scalable technical solutions, and partner effectively with technical teams, business stakeholders, and leadership.
  • Experience working in the insurance industry, preferably Property & Casualty, commercial lines; preferred experience with Python, PySpark, Azure Databricks, Delta Lake, Power BI semantic models, Microsoft Fabric, Synapse Spark Pools, REST API integrations, event-driven architectures, Master Data Management, and Microsoft Azure Data Engineer certification such as DP-203.

Salary Range: $155,000 – $160,000.  Actual compensation for this role will depend on several factors including the cost of living associated with your work location, your qualifications, skills, competencies, and relevant experience.


At Sompo, we recognize that the talent, skills, and commitment of our employees drive our success. This is why we offer competitive, high-quality compensation and benefit programs to eligible employees.


Our compensation program is built on a foundation that promotes a pay-for-performance culture, resulting in higher incentive awards, on average, when the Company does well and lower incentive awards when the Company underperforms.  The total compensation opportunity for all regular, full-time employees is a combination of base salary and incentives that gets adjusted upfront based on overall Company performance with final awards based on individual performance.


We continuously evaluate and update our benefit programs to ensure that our plans remain competitive and meet the needs of our employees and their dependents.  Below is a summary of our current comprehensive U.S. benefit programs:


  • Two medical plans to choose from, including a Traditional PPO & a Consumer Driven Health Plan with a Health Savings account providing a competitive employer contribution
  • Pharmacy benefits with mail order options
  • Dental benefits including orthodontia benefits for adults and children
  • Vision benefits
  • Health Care & Dependent Care Flexible Spending Accounts
  • Company-paid Life & AD&D benefits, including the option to purchase Supplemental life coverage for employee, spouse & children
  • Company-paid Disability benefits with very competitive salary continuation payments
  • 401(k) Retirement Savings Plan with competitive employer contributions
  • Competitive paid-time-off programs, including company-paid holidays
  • Competitive Parental Leave Benefits & Adoption Assistance program
  • Employee Assistance Program
  • Tax-Free Commuter Benefit
  • Tuition Reimbursement & Professional Qualification benefits

Who we are and what we stand for:

At Sompo, our shared purpose is to create meaningful value for clients, communities, and each other. We strive to foster a workplace where everyone feels respected, included, and empowered to excel. As a global organization, we embrace diversity and champion equal opportunity. Guided by our core values—Accountability, Agility, Collaboration, Development, and Integrity—we build trust and support one another to achieve our goals worldwide. Life at Sompo page


Our values come to life in how we hire and grow talent. Employment decisions are based on qualifications, merit, and organizational need, and we strive to ensure equitable access to opportunities so everyone can do their best work. If you need an accommodation for any part of the application process, please contact the recruiter in charge.


Skills Required

  • 10+ years of experience in data engineering, ETL/ELT development, and enterprise data warehousing
  • Hands-on expertise with Microsoft SQL Server, advanced T-SQL, SSIS, Azure Data Factory, Synapse Pipelines, performance tuning, query optimization, indexing, and production troubleshooting
  • Experience designing, developing, optimizing, and supporting Azure-based data platforms, including Azure Synapse Analytics, dedicated and serverless SQL workloads, Azure Data Lake Storage Gen2, cloud ingestion, pipeline orchestration, and legacy workload migration
  • Experience with dimensional and relational data modeling, Star Schema, Snowflake Schema, fact and dimension tables, data marts, stored procedures, views, functions, SQL scripts, and data warehouse solutions
  • Experience building and supporting production data pipelines with data quality checks, validation, reconciliation, exception handling, logging, monitoring, alerting, root cause analysis, and operational support practices
  • Experience with Azure DevOps or Git, source control, branching, code management, release management, CI/CD deployments, environment migrations, documentation, metadata management, data governance, and data lineage
  • Strong analytical, problem-solving, communication, stakeholder management, collaboration, prioritization, and business-to-technical translation skills
  • Experience working in the insurance industry, preferably Property & Casualty or commercial lines
  • Experience with Python, PySpark, Azure Databricks, Delta Lake, Power BI semantic models, Microsoft Fabric, Synapse Spark Pools, REST API integrations, event-driven architectures, or Master Data Management
  • Microsoft Azure Data Engineer certification such as DP-203
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Hamilton
314 Employees
Year Founded: 2020

What We Do

As one of the leading writers of crop insurance in the United States, AgriSompo North America blends extensive industry experience with cutting-edge software development to provide powerful, proactive agricultural risk management for the nation’s farmers and ranchers.   We operate within a culture of integrity, and a deeply rooted belief that collaboration, agility, and stellar customer service are crucial to long-term success. Our nationwide network of independent crop insurance agents provides direct and customized options to fit each producer’s needs, with solutions ranging from traditional multi-peril, crop hail, and livestock insurance to highly innovative and unique private products.

Similar Jobs

NBCUniversal Logo NBCUniversal

Senior Data Engineer

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
New York, NY, USA
115K-145K Annually

SoFi Logo SoFi

Senior Data Engineer

Fintech • Mobile • Software • Financial Services
Easy Apply
Remote or Hybrid
United States
4500 Employees
125K-234K Annually

Pontera Logo Pontera

Senior Data Engineer

Fintech • Software • Financial Services
Hybrid
New York, NY, USA
250 Employees
180K-220K Annually

New York Life Logo New York Life

Data Engineer

Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
New York, NY, USA
12000 Employees
100K-143K Annually

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Amalgamated Sugar Thumbnail
Food • Greentech • Agriculture • Industrial • Manufacturing
Boise, Idaho
768 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account