Sr Data Integration Engineer

Posted 2 Days Ago
Be an Early Applicant
6 Locations
In-Office
94K-143K Annually
Senior level
Fintech • Financial Services
The Role
Develops and administers complex ETL and ELT data integration solutions using Microsoft Fabric, SQL Server, Lakehouses, Warehouses, pipelines, notebooks, and SSIS. Designs reliable data flows, consumption views, semantic datasets, and enterprise data models; troubleshoots data quality and pipeline issues; supports database administration, backup and recovery, reporting, deployment, and CI/CD. Collaborates with business, analytics, technical, vendor, and reporting teams to deliver secure, scalable, trusted data products.
Summary Generated by Built In

Empowered to live. Inspired to work.
Compeer Financial is a member-owned cooperative located in Illinois, Minnesota and Wisconsin. We bring together team members with a variety of backgrounds and experiences to help provide financial services to support agriculture and rural communities. Join us in a culture that not only promotes meaningful work and professional development, but provides a flexible, hybrid work environment and excellent benefits, which empower you to thrive both personally and professionally.

How we support you:

  • Hybrid model – up to 50% work from home
  • Flexible schedules including ample flexibility in the summer months
  • Up to 9% towards 401k (3% fixed Compeer contribution plus up to 6% match)
  • Benefits: medical, dental, vision, HSA/FSA, life & AD&D insurance, short-term and long-term disability, wellness program & EAP
  • Vacation, sick leave, holidays/floating holidays, parental leave, and volunteer paid time off
  • Learning and development programs
  • Mentorship programs
  • Cross-functional committee opportunities (i.e. Inclusion Council, emerging professional groups, etc.)
  • Professional membership/certification reimbursement and more!

Casual/seasonal & intern team members are not eligible for benefits except for state-mandated programs.

To learn more about Compeer Financial visit www.compeer.com/careers. 

This position offers a hybrid work option up to 50% remote and is open to any Compeer office location in Illinois, Minnesota and Wisconsin.

The contributions you will make: 

This position is responsible for the development, enhancement and effective operations of complex data movement between various systems using ETL methodologies. Responsible for leading company database development efforts and coordinating with business users, consultants/contractors, vendors and internal team members to maximize the usage and value of company data assets. In many cases ETL processes are used to extract data from source systems, transform and enrich the data, and load it into the Data Warehouse.

A typical day: 

ELT/ETL Development

  • Designs, builds, deploys, and maintains data integration solutions using Microsoft Fabric, including Data Factory pipelines, Dataflows Gen2, notebooks, Lakehouses, Warehouses, and SQL Server Integration Services (SSIS) where applicable.
  • Develops, maintains, and administers data platform databases, Lakehouses, Warehouses, and related data integration components.
  • Functions as a primary contributor in designing, coding, testing, and debugging ETL/ELT pipelines and processes to create reliable, seamless data flows across source systems and the enterprise data platform.
  • Supports the overall strategy for Microsoft Fabric, data warehouse, Lakehouse, and database development, including adoption of scalable and reusable data integration patterns.
  • Monitors, troubleshoots, and analyzes pipeline failures, data anomalies, inconsistencies, and other data integration issues identified through monitoring, technical team members, and end users.
  • Creates automated, repeatable, and stable processes for data ingestion, transformation, validation, synchronization, and publishing across the data platform.
  • Develops database and data integration requirements for data migrations, business-unit initiatives, and SQL Server/Fabric projects using SQL, PySpark, notebooks, pipelines, and other appropriate technologies.
  • Identifies and resolves data integrity, quality, and reconciliation issues between source systems, Lakehouses, data warehouses, and downstream reporting or application consumers.
  • Applies data engineering best practices for security, performance, documentation, source control, testing, and deployment across Microsoft Fabric environments.

Consumption Views

  • Supports reporting, analytics, and application users by designing and creating secure, performant consumption views and curated data products in Microsoft Fabric Lakehouses and Warehouses.
  • Creates logical relationships across source systems, Lakehouses, Warehouses, and enterprise data models to provide consistent, trusted data for reporting and analytics.
  • Develops and maintains SQL views, semantic-model-ready datasets, and reusable data structures using SQL and Microsoft Fabric tools.
  • Partners with reporting, analytics, and business teams to define common calculations, data definitions, and access requirements.

Database Administration

  • Supports overall strategy related to database and data warehouse development.
  • Actively participates with the Business Technology department in preparing and implementing backup and disaster recovery procedures and processes for mission critical databases.
  • Contributes to data dictionaries and database diagrams for complex in-house databases.
  • Provides on-call support for problem resolution of database related issues.

The skills and experience we prefer you have: 

  • Bachelor’s degree in computer science, engineering, MIS or related field or an equivalent combination of education and experience sufficient to perform the essential functions of the job.
  • Minimum of 5 years of experience with various MS SQL environments (2008, 2012, 2014, 2017), designing and implementing SSIS packages and ETL development using SQL Server Data Tools.
  • SQL Server and/or other Microsoft technologies preferred.
  • Advanced knowledge of SQL, including T-SQL, data modeling, normalization, data types, query tuning, indexing, constraints, query plans, and relational database concepts.
  • Experience with Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Data Factory pipelines, Dataflows Gen2, notebooks, and related data engineering capabilities.
  • Advanced experience with SSRS, Power BI, Microsoft Fabric reporting, or comparable reporting and analytics tools.
  • Experience designing data solutions for both operational (OLTP) and analytical/data warehouse environments.
  • Experience with software deployment, source control, CI/CD pipelines, build automation, and promoting solutions across development, test, and production environments.
  • Ability to translate complex technical concepts and data issues into clear, non-technical language.
  • Advanced client-service skills and a strong customer-focused mindset.
  • Strong listening, written, and verbal communication skills, with the ability to communicate effectively at all levels of the organization.
  • Ability to work independently and collaboratively across teams to achieve shared goals and represent business needs.
  • Valid driver’s license.

#IND100

How we will take care of you:

Our job titles may span more than one career level (associate, senior, principal, etc.). The actual title and base pay offered is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. This role is eligible for variable compensation and other benefits.

Base Pay
$94,400$142,900 USD

Compeer Financial is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.

Must be authorized to work for any employer in the United States. Compeer is unable to sponsor or take over sponsorship of an employment visa at this time.

Click here to view federal employment laws applicable for applicants.

Skills Required

  • Bachelor’s degree in computer science, engineering, MIS, or a related field, or equivalent education and experience
  • Minimum of 5 years of experience with Microsoft SQL environments and SSIS package and ETL development using SQL Server Data Tools
  • Experience with SQL Server and other Microsoft technologies
  • Advanced knowledge of SQL and T-SQL, including data modeling, normalization, data types, query tuning, indexing, constraints, query plans, and relational database concepts
  • Experience with Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Data Factory pipelines, Dataflows Gen2, notebooks, and data engineering capabilities
  • Advanced experience with SSRS, Power BI, Microsoft Fabric reporting, or comparable reporting and analytics tools
  • Experience designing data solutions for both operational OLTP and analytical data warehouse environments
  • Experience with software deployment, source control, CI/CD pipelines, build automation, and promoting solutions across development, test, and production environments
  • Ability to translate complex technical concepts and data issues into clear, non-technical language
  • Advanced client-service skills and a customer-focused mindset
  • Strong listening, written, and verbal communication skills
  • Ability to work independently and collaboratively across teams
  • Valid driver’s license
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sun Prairie, WI
853 Employees
Year Founded: 2017

What We Do

SmartStream is a recognised leader in financial transaction management solutions that enables firms to improve operational control, reduce costs, build new revenue streams, mitigate risk and comply accurately with regulations. By helping its customers through their transformative digital strategies, SmartStream provides a range of solutions for the transaction lifecycle with artificial intelligence and machine learning technologies embedded - which can also be deployed in the cloud or as managed services. As a result, more than 2,000 clients—including 70 of the world’s top 100 banks, rely on SmartStream Transaction Lifecycle Management (TLM®) solutions to deliver greater efficiency to their operations.

Similar Jobs

In-Office or Remote
Eden Prairie, MN, USA
157 Employees
153K-178K Annually
In-Office
7 Locations
120K-141K Annually

Bestow Logo Bestow

Senior Data Analyst

Big Data • Fintech • Information Technology • Insurance • Software
Remote or Hybrid
US
160 Employees
115K-135K Annually

Squarespace Logo Squarespace

Senior Product Director, Client Engagement Group

Consumer Web • eCommerce • Marketing Tech • Payments • Software • Design • SEO
Remote or Hybrid
United States
1723 Employees
323K-435K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account