Top Senior Data Engineer Jobs in Minneapolis, MN

Build and operate scalable cloud data pipelines, warehouses, transformation layers, and ML production systems. Lead data infrastructure architecture, warehouse performance optimization, DataOps monitoring, CI/CD improvements, data quality testing, and large-scale data product delivery. Collaborate across teams, promote data stewardship, and support batch and streaming pipelines while deploying, serving, and monitoring machine learning models.

Own the architecture and technical direction of Northbeam’s data ingestion and integration platform. Design scalable API-based ETL, event-driven and batch processing systems; establish standards for observability, freshness, and failure handling; and guide build-versus-buy decisions. Collaborate across engineering, infrastructure, product, and business teams while mentoring engineers, leading design reviews, and driving complex platform initiatives to completion.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Own and evolve the data infrastructure powering identity and fraud products. Build and operate scalable ETL/ELT pipelines, ensure data quality and observability, optimize storage and access, support product squads, respond to production incidents, mentor engineers, and drive data platform innovation.

Designs and maintains healthcare data pipelines, ETL workflows, databases, data models, and analytical frameworks. Analyzes claims and payer data to identify trends and insights, while ensuring data quality and integrity. Creates reports, dashboards, and visualizations for nontechnical stakeholders and collaborates with healthcare policy experts, analysts, and other stakeholders to translate requirements into data solutions. The role also improves data infrastructure and analytics capabilities.

Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.

Build and maintain modern data-centric applications, pipelines, transformations, enrichment processes, provisioning layers, and user interfaces supporting clinical and operational healthcare processes. Analyze clinical data and report trends using cloud, big data, data science, and modern software development practices. Collaborate with Product, Platform, and Architecture teams, mentor Data Engineers, document solutions, manage source control, and research emerging technologies.

Develops and administers complex ETL and ELT data integration solutions using Microsoft Fabric, SQL Server, Lakehouses, Warehouses, pipelines, notebooks, and SSIS. Designs reliable data flows, consumption views, semantic datasets, and enterprise data models; troubleshoots data quality and pipeline issues; supports database administration, backup and recovery, reporting, deployment, and CI/CD. Collaborates with business, analytics, technical, vendor, and reporting teams to deliver secure, scalable, trusted data products.

Architect, build, and operate low-latency market data systems, including feed handlers, normalization, distribution, and exchange connectivity. Design high-throughput infrastructure for real-time trading data, improve reliability and performance, participate in observability, on-call, and incident response, and deliver well-tested features end to end. Partner with engineering, product, and cross-functional stakeholders while leading a lean, high-impact team.

Design and deliver modern data platforms, scalable and secure ingestion and transformation pipelines, durable data models, streaming systems, and reporting layers. Partner directly with clients and business stakeholders to translate requirements into architecture, explain tradeoffs, and own delivery outcomes. The role includes production implementation across cloud data platforms, orchestration, governance, real-time technologies, and analytics or AI data consumption.

Build Sailor Health’s foundational data platform from scratch. Responsibilities include developing Snowflake and dbt pipelines integrating EHR, CRM, and communications data; creating data-powered web applications; automating clinical and billing workflows with Python; analyzing therapy transcripts and patient data using AI and machine learning; tracking clinical outcomes; and designing scalable data architectures in collaboration with clinicians, engineers, founders, and other teams.

Own and evolve Worldly’s production data lake, Postgres warehouse, CDC and streaming pipelines, dbt transformations, orchestration, BI access controls, and graph integrations. Maintain reliable, governed analytics infrastructure using Iceberg, Trino, Dagster, Terraform, and AWS. Support production generative AI workflows involving embeddings, similarity search, extraction, and classification. Responsibilities include data quality, monitoring, security, incident response, disaster recovery, schema governance, and collaboration with data science and analytics stakeholders.

Designs, administers, and optimizes data systems supporting FSA IAM applications. Develops migration plans from legacy AIMS and PAS systems, creates data models, mappings, layouts, dictionaries, and integration processes, and supports analytics and fraud detection. Manages database configuration, performance tuning, monitoring, backups, capacity, secure data handling, encryption, network data flows, token management, and documentation while collaborating with development, security, and operations teams.

Manage, design, and optimize data activities for federal IAM systems. Develop data models, file layouts, source-to-target mappings, data dictionaries, integrations, ETL processes, and analytics support for identity analysis and fraud detection. Administer and tune databases, including configuration, backups, monitoring, capacity planning, and performance optimization. Support secure handling of identity and PII data, network-related data flows, documentation, token management processes, and collaboration across development, security, and operations teams.

Designs, builds, and operates scalable enterprise data platforms supporting ingestion, processing, storage, governance, analytics, and AI/ML. Responsibilities include developing batch and real-time pipelines, lakehouse and warehouse architectures, orchestration, infrastructure automation, CI/CD, monitoring, security, cost optimization, and observability. The role partners with data, ML, DevOps, security, and application teams, troubleshoots complex platform issues, establishes reusable engineering standards, contributes to architecture strategy, and mentors engineers.

Own end-to-end data platform architecture across ingestion, transformation, modeling, and serving. Improve warehouse efficiency, access control, reliability, observability, orchestration, CI/CD, and developer experience. Lead cross-functional technical initiatives, build monitoring and alerting, mentor engineers, guide architectural decisions, and develop AI-powered data tooling. The role requires strong SQL and Python skills, production experience with Airflow, BigQuery, and containerized infrastructure, plus architectural ownership and stakeholder communication.

Senior ETL Data Developer to design, build, test, and support Epic Clarity and enterprise ETL solutions using SSIS (and DataStage). Develop and optimize ETL workflows, implement standards, troubleshoot complex integration issues, document designs, and collaborate with reporting, analytics, and business teams to deliver data warehouse solutions and integrations.

Design, build, maintain, and optimize Spark and Scala ETL/ELT pipelines on AWS for terabyte- and petabyte-scale datasets. Work across S3, Snowflake, Kafka, and monitoring systems, resolve production data-quality and performance issues, write automated tests, participate in architecture and code reviews, and support on-call operations. Use generative AI to improve pipeline development, monitoring, and engineering productivity.

Lead architecture and hands-on engineering to design, scale, and govern a cloud-native lakehouse using Databricks and Microsoft Fabric. Build batch/streaming pipelines, ensure HIPAA-compliant PHI handling, produce analytics-ready datasets, mentor engineers, and drive platform strategy, governance, and reliability.

Design and implement end-to-end data solutions on Microsoft Fabric and Azure for insurance datasets. Build ingestion pipelines (batch, streaming, API), Lakehouse architectures, and data models. Enforce governance, security, compliance, and cost/performance optimizations while guiding engineers and stakeholders on architectural best practices.

Develop and maintain large-scale, cloud-native data services and distributed pipelines for multi-tenant healthcare systems. Responsibilities include data modeling, database component development, SQL programming, performance tuning, testing, deployment, code reviews, proof-of-concepts, and full software development lifecycle ownership. Collaborate with global engineering teams, evaluate technologies, apply security and operational requirements, and use AI tools to accelerate development.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.

Build and maintain low-latency, highly available distributed data systems and services to deliver high-quality data for product, analytics, and ML. Partner with data scientists and product teams to design scalable, observable, multi-tenant data products using batch and real-time processing frameworks. Ensure 24x7 reliability, monitoring, and operational excellence while owning end-to-end delivery.

Design, build, and own large-scale batch and streaming data pipelines and core Ads data products. Collaborate with analytics, data science, and engineering teams to model, transform, govern, and deliver high-quality ad datasets for analysis, ML, and reporting while ensuring privacy compliance.

Leads data engineering strategy and mentors an analytics engineering team. Designs scalable ELT pipelines, warehouse integrations, data models, API ingestion workflows, and data quality frameworks using cloud and database technologies. Conducts exploratory analysis, supports dashboards and analytical solutions, monitors warehouse performance and costs, and ensures data governance, security, and compliance. Collaborates with data scientists, analysts, engineers, and business stakeholders to deliver healthcare analytics solutions.