Top Senior Data Engineer Jobs in Minneapolis, MN

Design, develop, and maintain PySpark applications and ETL pipelines to process, transform, and integrate large-scale datasets from SQL, NoSQL, data lakes, and streaming sources. Optimize Spark job performance, implement robust error handling, and collaborate with data analysts, scientists, and architects using orchestration tools like Airflow or Luigi.

Design, develop, and maintain scalable ETL/ELT pipelines and Snowflake data models; optimize performance; ensure data quality and integrations with CRM/ERP/billing systems; collaborate with stakeholders and evolve a Snowflake/dbt cloud-native data platform.

Design, build, and maintain scalable data systems and ETLs on GCP; connect production data to business systems; generate analytics and ML-driven insights for GTM teams; work cross-functionally and introduce modern tools (Airflow, DBT, Presto, Hightouch).

Design, build, and maintain scalable batch and streaming data pipelines, improve data modeling and governance, contribute to enterprise data architecture, and collaborate with cross-functional teams to ensure reliable, high-quality data for analytics and operational use.

Work directly with customers to design, build, and maintain data integrations and pipelines, troubleshoot ingestion/transformation/delivery issues, optimize large-scale data processing, collaborate with data scientists, and guide technical onboarding and long-term success.

The Senior Data Engineer will design scalable data processing frameworks using Java and Apache Spark, manage data pipelines, and mentor junior engineers.

Design, build, and maintain an internal data platform enabling secure, governed access for engineering and analytics. Partner with architects, implement data pipelines and automations, enforce security and compliance, support platform services, recommend architecture improvements, mentor teams, and drive adoption of scalable, self-service data capabilities.

Own end-to-end client data migrations: reverse-engineer legacy ETL, design and build Airflow DAGs and Spark jobs, validate and reconcile data at scale, document architecture and decisions, and coordinate cross-functional teams through go-live and hypercare.

Lead a team of data engineers to design, build, and maintain scalable data pipelines, a Data Vault, data warehouses and marts. Own backlog, sprint planning, mentoring, stakeholder collaboration, data validation/monitoring, and platform improvements to deliver key metrics and data infrastructure across the business.

Design, deploy, and maintain scalable data infrastructure and orchestration for analytics and ML; write optimized SQL over large warehouses; partner with engineering and product to structure source systems; maintain CDC pipelines; scale reporting and expose analytical datasets enterprise-wide while ensuring data management, security, and compliance.

Design and own end-to-end data platform architecture, build ingestion and transformation pipelines, model multi-tenant datasets, optimize Postgres and ClickHouse performance/cost, implement orchestration and observability, define data quality and reconciliation standards, and mentor data/product engineers.

Design, implement, and manage scalable multi-cloud data platforms and ELT pipelines (AWS/Azure). Build and optimize Snowflake data models, dbt transformations, and Airflow orchestration. Define data engineering standards, enforce governance and quality, collaborate cross-functionally, and mentor global/offshore teams.

Build and maintain automated ETL/ELT data pipelines, improve data quality and monitoring, optimize Postgres and BigQuery schemas and queries, develop internal tooling, support data governance (HIPAA), participate in on-call rotation, and collaborate across engineering teams to scale data systems.

The Data Engineer will design and maintain data pipelines, enhance the data warehouse, support machine learning applications, and collaborate with various teams to leverage data effectively.

The Senior Data Engineer will build and maintain ETL/ELT pipelines, optimize SQL queries, and collaborate on machine learning workflows, driving data engineering best practices.

Design, optimize, and scale Snowflake-based data architecture and pipelines. Implement data observability, operationalize MLOps, build semantic enterprise models, and deploy AI-assisted agents and automation for production analytics and commercial data products. Share cross-functional ownership for pipeline resilience, monitoring, and model lifecycle management.

As a Sr. Data Engineer at Lyra Health, you will build and scale core data infrastructure, design data warehouses, and create efficient data pipelines while collaborating across departments.

The Senior Data Engineer will design and maintain data pipelines, write production-grade Python and SQL code, and support AI initiatives while collaborating across teams.

The Data Architect/Data Governance Lead supports the Medicaid Enterprise Data Warehouse by leading data architecture, metadata management, and governance processes, ensuring compliance and scalability.

In this role, you will design data architecture, lead integration strategies, mentor engineers, and drive AI infrastructure for cross-division data systems.

The Sr. Data Engineer - Databricks designs and maintains scalable data solutions using Apache Spark and Databricks, ensuring data quality and performance for analytics and reporting.

Design, build, and maintain end-to-end batch and streaming data pipelines on GCP. Migrate legacy warehouses to BigQuery/Bigtable/ClickHouse, orchestrate workflows in Airflow, ensure data quality and observability, and partner with ML engineers on feature pipelines, drift monitoring, and retraining.

Design, build, and automate scalable batch and streaming data pipelines, implement data models and ETL, automate deployments, support ML/experimentation, maintain server architecture, and partner with stakeholders to deliver analytics and data-driven tools.

Own and architect the semantic layer and metrics/metadata for the data platform (Databricks/GCP). Build AI-ready models, enforce modeling and documentation standards, implement observability/testing for pipelines, enable self-serve analytics, and collaborate across product, clinical, and business teams to translate questions into reliable data solutions.

Design, operate, and scale end-to-end data infrastructure and pipelines. Build reusable data models and a semantic layer, ensure data quality and privacy, implement observability and SLAs, support marketing and growth feeds, partner with cross-functional stakeholders, and enable ML/AI consumption and reverse ETL workflows.