Top Senior Data Engineer Jobs in Minneapolis, MN

Design and optimize scalable Azure data and AI platforms using Databricks, Spark, Python, and Delta Lake. Build enterprise ETL/ELT pipelines, real-time processing frameworks, feature stores, and model input pipelines. Collaborate with AI teams to operationalize machine learning models, ensure data quality and security, automate engineering workflows, and optimize performance. Participate in Agile development, CI/CD, testing, production support, and on-call operations while developing responsible AI-powered solutions.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Designs, develops, and maintains scalable data pipelines, streaming applications, data platforms, and AI-powered solutions. Uses Python, Spark, Scala, Kafka, and cloud technologies to support enterprise healthcare systems. Responsibilities include data modeling, warehousing, database design, performance tuning, workflow automation, vulnerability remediation, platform upgrades, data security, and operational stability. Collaborates with cross-functional teams to translate data requirements into high-performing technical solutions.

Designs, develops, deploys, and supports scalable cloud data engineering solutions for HEDIS processing and healthcare quality reporting. Builds ETL pipelines, data integrations, SQL transformations, and AI-enabled workflow automation. Collaborates with stakeholders, auditors, and product teams to ensure data quality, regulatory compliance, and operational reliability. Troubleshoots production issues, supports cloud modernization, applies CI/CD and testing practices, and mentors engineers as a senior individual contributor.

Designs, builds, and maintains secure data pipelines, ETL processes, data warehouses, and quality controls. Collects, validates, cleanses, and analyzes data; develops SQL queries, Tableau dashboards, and AWS-based solutions; investigates data integrity issues; documents standards; and partners with stakeholders to deliver technical solutions using Agile and DevOps practices.

Build and operationalize data pipelines and solutions supporting AI, machine learning, and business intelligence. Analyze data sources, implement transformations, governance, security, and quality practices, test data movement and code, resolve defects, and collaborate with business users. The role also involves educating users on data products and contributing to data platform design and continuous improvement.

Design, develop, and support scalable ETL frameworks and data integration pipelines for complex healthcare datasets in Oracle Exadata environments. Responsibilities include data mapping, transformation, performance tuning, testing, troubleshooting, automation, documentation, data profiling, validation, reconciliation, and quality assurance. The role also supports secure coding standards, code reviews, operational reliability, and integration with modern cloud data platforms.

Own Eve’s data platform end to end, including ingestion, orchestration, incremental dbt models, Snowflake administration, Terraform infrastructure, observability, access controls, and pipeline reliability. Build schema-change detection, freshness SLAs, CI environments, and incident processes while managing performance and compute costs. Partner with analytics engineers and stakeholders to maintain trusted data for reporting and AI systems, using AI-assisted development and documenting platform standards.

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.

Design, build, and operate scalable batch and streaming data pipelines, lakehouse and warehouse models, and data services. Own datasets end to end, improve Snowflake, Iceberg, Spark, and Flink performance and reliability, implement governance and observability, and support graph-serving data models. Partner with product and engineering teams, participate in on-call, review code and designs, and mentor junior engineers.

Design, build, and maintain Keboola-based data pipelines integrating multiple business systems to deliver accurate, scalable data for supply chain, logistics, and transportation analytics; collaborate with analysts and engineers; support documentation, governance, and pipeline automation.

Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.

Build and own Snout’s data foundation, including PostgreSQL and dbt warehouses, ingestion pipelines, dimensional models, data quality, documentation, and reliable rebuilds. Reconcile data from veterinary practice-management systems, support LLM/AI tooling, translate stakeholder needs into technical plans, and establish the foundation for a future data team and analyst.

Design, develop, and operate large-scale data ingestion, transformation, enrichment, and processing pipelines across cloud, hybrid, and on-premises environments. Build distributed services using Java, Python, and Kafka; optimize data models and platform performance; deploy applications on Kubernetes; support infrastructure automation and CI/CD; troubleshoot production systems; and collaborate with customers and solution architects on implementations.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Lead the architecture and development of Vercel’s next-generation data platform, supporting batch and real-time integrations, analytics, data warehousing, and AI/ML workloads. Design scalable systems using Kafka, ClickHouse, Tinybird, and Snowflake; establish data governance and security standards; guide architectural decisions and roadmaps; collaborate with engineering, product, security, compliance, and leadership teams; write production code; and mentor engineers.

Build and maintain Databricks-based data platforms, including ingestion, transformation, storage, governance, data modeling, and serving pipelines. Establish medallion architecture standards, canonical data models, quality controls, lineage, schema evolution, and reliable batch or incremental processing. Improve pipeline observability, scalability, idempotency, and recoverability while moving curated data to systems such as ClickHouse. Collaborate across application and analytics teams to create durable, governed production datasets.

Build, deploy, and operationalize data pipelines and solutions supporting AI, machine learning, and business intelligence. Responsibilities include data transformation, cleansing, governance, security, quality management, source analysis, testing, incident resolution, and defect remediation. The role collaborates across teams, supports data products, educates users, and applies software engineering and DevOps practices to deliver reliable analytical data solutions.

Technical lead for Finance Technology data engineering: design and build scalable batch and real-time data pipelines (Hadoop/Spark/PySpark/Scala/Java), optimize data models and APIs, drive cloud-based data architecture (AWS/GCP/Azure), enforce governance/security, and mentor engineers to deliver enterprise financial data services.

Develop and optimize enterprise Oracle SQL and PL/SQL solutions, including data models, database designs, APIs, ETL processes, batch jobs, and performance tuning. Collaborate with cross-functional teams to translate requirements into scalable implementations, support testing and CI/CD, troubleshoot production issues, and document solutions. Provide technical leadership, mentor engineers, participate in architecture and code reviews, and drive engineering best practices across data modernization initiatives.

Design, build, and operate scalable ETL/ELT pipelines and backend data services using Go. Integrate relational, NoSQL, blockchain, API, web, and social data sources; develop NLP pipelines for text extraction and classification; and support production APIs, dashboards, alerts, and intelligence systems. Collaborate with engineering, data science, and investigations teams on architecture, data quality, lineage, validation, monitoring, and client-facing products.

Leads data engineering and data science teams, setting strategy and delivering scalable pipelines, data architecture, models, analytics infrastructure, and data governance. Partners with product, analytics, and business stakeholders to prioritize initiatives, assess upstream changes, maintain data quality, and support Snowflake-based warehousing. This hands-on leadership role includes mentoring staff, contributing to technical codebases, and advancing data science and engineering solutions.

Build GCP data pipelines, ETL/ELT processes, integrations, data models, and analytics solutions. Support AI/ML development with Vertex AI and Gemini, including MLOps, prompt engineering, embeddings, and RAG experimentation. Participate in client requirements gathering, technical implementation, data governance, quality, security, monitoring, and documentation while collaborating with senior engineers and architects.

Design, build, and maintain scalable batch and streaming data pipelines using Python, SQL, Kafka, and GCP. Develop REST and GraphQL data services, CI/CD automation, observability, and data-quality frameworks. Integrate ML and NLP models into production workflows, including continuous retraining and real-time inference. Support structured and unstructured healthcare datasets, distributed systems, microservices, and reliable data infrastructure while collaborating with data science and MLOps teams.

Build and configure a government Databricks workspace, develop ingestion and integration pipelines from enterprise and legacy systems, and prepare data for reporting. Implement Unity Catalog governance, metadata management, auditing, and lineage; configure MLflow workflows; assess security controls for sensitive data; and create architecture documentation, data dictionaries, and SOPs to support long-term sustainment.