Top Senior Data Engineer Jobs in Minneapolis, MN

Lead data engineering strategy and develop enterprise data lake solutions on AWS. Build data pipelines using AWS data integration, engineering, and analytics resources, develop API services with FastAPI or Flask, optimize engineering practices, create long-term data plans, and represent the team in executive meetings.

Build and maintain dbt and semantic data models in Snowflake, develop ingestion and transformation pipelines, define trusted product metrics, and improve data collection. Partner with Product and Engineering to support experimentation and feature analysis. Establish data quality testing, documentation, HIPAA-aware access controls, and compliance practices. Use and validate AI-generated code and Snowflake Cortex outputs while raising technical standards across the team.

Technical lead for Finance Technology data engineering: design and build scalable batch and real-time data pipelines (Hadoop/Spark/PySpark/Scala/Java), optimize data models and APIs, drive cloud-based data architecture (AWS/GCP/Azure), enforce governance/security, and mentor engineers to deliver enterprise financial data services.

Develop and optimize enterprise Oracle SQL and PL/SQL solutions, including data models, database designs, APIs, ETL processes, batch jobs, and performance tuning. Collaborate with cross-functional teams to translate requirements into scalable implementations, support testing and CI/CD, troubleshoot production issues, and document solutions. Provide technical leadership, mentor engineers, participate in architecture and code reviews, and drive engineering best practices across data modernization initiatives.

Design, build, and operate scalable ETL/ELT pipelines and backend data services using Go. Integrate relational, NoSQL, blockchain, API, web, and social data sources; develop NLP pipelines for text extraction and classification; and support production APIs, dashboards, alerts, and intelligence systems. Collaborate with engineering, data science, and investigations teams on architecture, data quality, lineage, validation, monitoring, and client-facing products.

Design, build, and maintain scalable batch and streaming data pipelines using Python, SQL, Kafka, and GCP. Develop REST and GraphQL data services, CI/CD automation, observability, and data-quality frameworks. Integrate ML and NLP models into production workflows, including continuous retraining and real-time inference. Support structured and unstructured healthcare datasets, distributed systems, microservices, and reliable data infrastructure while collaborating with data science and MLOps teams.

Architect, build, and operate scalable data platforms processing billions of daily events through real-time and batch pipelines. Own production reliability, data quality, security, observability, and performance while partnering with engineering, analytics, data science, growth, and business teams. Develop frameworks and datasets, make architectural decisions, evaluate technologies, mentor engineers, and help define the platform roadmap.

Design and lead scalable, secure, highly available database infrastructure for multi-terabyte SQL Server environments. Set technical direction for data architecture, performance, real-time pipelines, security, and growth. Troubleshoot complex production issues, optimize queries and indexes, guide cross-functional projects, mentor engineers, review changes, reduce technical debt, and evaluate emerging technologies. Monitor database health using Splunk, Datadog, and Grafana while influencing engineering and Site Reliability strategy.

Build and operate a large-scale enterprise data platform spanning batch and streaming processing, lakehouse storage, Kafka infrastructure, APIs, observability, and agentic MCP interfaces. Develop reusable ingestion and data-quality frameworks, improve scalability and resilience, establish engineering practices, support production operations, and mentor engineers. The role requires deep ownership of distributed data infrastructure and practical use of AI coding agents.

Design and operate production-grade data pipelines, backend services, APIs, and agentic AI workflows. Build scalable systems that ingest, transform, and operationalize data for customer-facing and internal applications. Translate ambiguous operational workflows into reliable architectures, improve service observability and performance, and own technical decisions across data modeling, system design, security, and compliance.

Own and expand Chicory’s analytical data platform supporting advertising, campaign, financial, product, and publisher reporting. Design BigQuery architecture, build batch and streaming pipelines with Python, SQL, Beam, Dataflow, and Airflow, and develop governed data marts and BI datasets. Establish data quality, observability, reconciliation, access controls, cost management, and engineering practices. Partner with engineering, finance, product, campaign management, sales, and leadership while leading incident recovery and documenting systems.

Build scalable, secure data pipelines, models, platforms, and governance systems that enable AI applications to access trusted enterprise data. Partner with analytics, marketing, and product teams to translate requirements into technical solutions, independently deliver projects through production, and support sensitive-data security and access controls. Preferred experience includes LLM architectures, cloud data platforms, infrastructure as code, regulated environments, and technical leadership.

Lead technical design and hands-on development of Pantheon’s data platform, extending ingestion, curation, retention services and ML/LLM infrastructure. Mentor engineers, drive architecture and engineering standards, operate in a DevOps model, partner cross-functionally, and participate in on-call support to ensure reliable, compliant data access and analytics.

Provides hands-on technical leadership for foundational data engineering and analytics engineering. Owns multi-year data architecture, production pipelines, dimensional models, and trusted metrics spanning cloud costs, traffic, infrastructure, and AI usage. Designs new datasets integrating cost, utilization, performance, and reliability signals; establishes standards, coaches engineers, aligns stakeholders, and drives adoption across Infrastructure, Finance, Data Science, and Product Engineering.

Own and evolve production data systems supporting healthcare, claims, billing, analytics, and reporting. Design resilient ingestion patterns, data contracts, models, schemas, and pipelines that handle incomplete, duplicated, delayed, and changing data. Improve performance, observability, failure handling, retries, backfills, and replay safety. Collaborate with engineering, product, operations, and analytics teams while making architecture decisions and documenting technical changes.

Lead data engineering and machine learning initiatives by designing, architecting, developing, and supporting GCP data pipelines. Create information architecture documentation, estimate and plan technical work, collaborate with project teams and business analysts, and translate requirements into technical designs. Develop Python-based ELT pipelines, optimize BigQuery SQL, support CI/CD, and provide technical leadership to projects and teams.

Leads the architecture, development, and support of enterprise data warehouses, lakehouses, dimensional models, ETL/ELT pipelines, and governed data products using Microsoft Fabric and related tools. Ensures data quality, security, scalability, performance, and reliability for analytics and reporting. Partners with technical and business stakeholders, documents data solutions, guides architecture decisions, mentors team members, and drives continuous improvement of data engineering standards and practices.

Designs and maintains scalable ETL pipelines, data models, integrations, cloud databases, and healthcare data infrastructure. Ensures security, HIPAA/HITRUST compliance, reliability, monitoring, and documentation while collaborating with product, engineering, and clinical teams. Requires strong SQL and Python expertise, modern data warehousing and orchestration experience, cloud platform knowledge, and familiarity with healthcare interoperability and claims data.

Lead Data Engineer responsible for designing, maintaining, and improving data pipelines and platform infrastructure across ingestion, streaming, transformation, and delivery. The role uses Airflow, Spark, Iceberg, Kafka, Flink, dbt, Terraform, and GCP. Responsibilities also include defining data contracts, documenting systems, optimizing performance, reviewing code, supporting access controls and compliance, and collaborating with stakeholders and teammates.

Leads data engineering teams in designing, developing, and supporting scalable batch and streaming data solutions. Responsibilities include data pipeline development, architecture, governance, security, platform optimization, production support, technical mentorship, stakeholder collaboration, and delivery leadership. The role requires hands-on engineering with Python or similar languages, modern data technologies, cloud platforms, DevOps practices, and people-management responsibilities.

Designs and maintains ELT pipelines, warehouse integrations, data models, and data quality processes. Collaborates with data scientists, analysts, engineers, and stakeholders to deliver scalable analytical solutions. Responsibilities include data integration, governance, security, performance optimization, exploratory analysis, visualization, and cloud-based API ingestion. Requires strong SQL, DBT, Snowflake, Azure Data Factory, cloud, and scripting experience, plus leadership and communication skills.

Develops scalable data and software systems using Python and Apache Spark. Designs APIs, data models, ETL workflows, orchestration, and data interactions while optimizing performance, scalability, integrity, and security. Builds user interfaces, contributes to automated testing, applies Agile practices, and supports CI/CD delivery. The role requires strong software engineering, distributed computing, analytical, and communication skills, with AWS, R, Databricks, and SAS experience preferred.

Lead production of federal species range maps for marine and anadromous taxa. Aggregate, normalize, transform, and validate spatial data; analyze habitat intersects; coordinate iterative reviews with FWS and NOAA SMEs; prepare QA documentation; and secure government sign-off for map deliverables.

Build and operate reliable ETL and ELT pipelines across lakehouse and transactional systems. Develop data models, enforce governance, integrate diverse data sources, and support analytics, APIs, and predictive tools. Monitor performance, data quality, lineage, cost, and uptime while collaborating with data science, AI, product, and innovation teams.

Build and maintain automated ETL/ELT data pipelines, improve data quality and monitoring, optimize Postgres and BigQuery schemas and queries, develop internal tooling, support data governance (HIPAA), participate in on-call rotation, and collaborate across engineering teams to scale data systems.