Top Data Engineer Jobs in Madison, WI

Support building and maintaining ETL/ELT data pipelines and cloud data workflows. Work with senior engineers and cross-functional teams to implement, test, deploy, and document data processes. Continuously learn cloud technologies, SQL, and Python/PySpark, follow coding best practices, and contribute to process improvements in an Agile environment.

Design, build, and maintain scalable data pipelines and ETL/ELT frameworks using Python and PySpark. Develop reusable components, microservices, and cloud-based data solutions on AWS and Snowflake. Ensure code quality via reviews, CI/CD, logging, and best practices while collaborating with stakeholders to solve data problems.

As a Data Engineer, you will design and maintain data pipelines, support DoD systems, and ensure data quality and compliance.

Lead architecture and delivery of a cloud-native, petabyte-scale data platform: define technical roadmap, mentor engineers, build ETL/ELT pipelines, enable real-time streaming, implement Iceberg table format, optimize Snowflake/Redshift/Athena compute, and integrate observability with Splunk.

Design, build, and optimize scalable AWS-based data pipelines, data lakes, and warehouses. Migrate legacy systems, enforce data quality/security/governance, implement ETL/ELT and big-data solutions, adopt CI/CD and IaC, collaborate with stakeholders, and provide technical leadership and troubleshooting.

Build and maintain ingestion pipelines, Python services, and dbt models on AWS and Snowflake. Own operational on-call responsibilities, migrate pipelines to Airflow, contribute to CI/CD, collaborate with BI/Analytics, and mentor junior teammates.

Design, build, and maintain scalable data pipelines, lakes, and infrastructure using Databricks, Spark, Python, and AWS. Collaborate with ML engineers, data scientists, and analysts to deliver data products, ensure data quality and governance, implement DevOps/SDLC practices, mentor junior engineers, and evaluate new data technologies.

Design, build, modernize, and maintain operational and analytical data capabilities for Wealthscape Reporting, Analytics and Insights. Perform solution design, data analysis, ETL development, and production rollouts using Snowflake, AWS, cloud databases, and CI/CD pipelines. Collaborate across teams in a fast-paced financial services environment.

Design, build, and maintain operational and analytical data platform capabilities using Java Spring Batch, Python, AWS, Oracle, and Snowflake. Deliver end-to-end development, production rollout, and support; improve financial product data quality, modeling, and SQL performance; collaborate with business partners and squads.

Design, build, and maintain ETL/ELT data pipelines and orchestration using Airflow, Python, and PySpark. Develop custom connectors, implement DataOps and CI/CD for data workflows, monitor and troubleshoot pipelines, validate data quality, and document processes while collaborating with cross-functional teams and supporting large-scale distributed data systems.

Design, build, and maintain scalable data pipelines on AWS using EMR, Spark, and PySpark. Optimize EMR clusters and Spark jobs, implement ETL/ELT processes, ensure data quality, automate ingestion, and collaborate with data scientists and analysts. Document infrastructure, participate in code reviews, and monitor performance and costs.

Design, build, and maintain scalable batch and real-time data pipelines and platform components. Produce curated datasets, ensure data quality, observability, and lineage, and collaborate cross-functionally to deliver data products that support analytics, experimentation, and ML.

Build and maintain production data pipelines and models using SQLMesh, BigQuery, and Python. Improve observability, reliability, and performance; support finance and revenue pipelines; participate in on-call rotation and own features end-to-end.

Design, build, and maintain data integration and ETL solutions to implement client hospital data into Meduit platforms. Develop Python scripts, SQL queries, and data models; ensure data quality, transform and map source systems, and support data warehouse and architecture improvements during client implementations.

Develop and optimize SQL-based data solutions and ETL/ELT pipelines using DBeaver. Troubleshoot data quality and performance, validate data prior to production, document transformations, and collaborate with application owners and business stakeholders. Support testing, deployments, and knowledge transfer in a healthcare data environment.

Design, build, and maintain scalable batch and streaming data pipelines on Databricks using PySpark, Delta Lake, Unity Catalog, and cloud platforms. Troubleshoot performance and quality issues, implement data governance, collaborate with cross-functional teams, and document pipelines and data models to deliver reliable, production-ready data products.

Build and support high-performance data solutions, design and operate ETL pipelines and data warehouses, monitor production analytics tools, troubleshoot system issues, collaborate with product teams, and support TechOps for analytics infrastructure.

We are seeking a Data Engineer to design, build and optimize scalable data pipelines. Strong experience in Databricks, PySpark, and data warehouse concepts is required.

Design, develop, test, maintain, and support secure, scalable data solutions using Snowflake and Databricks. Lead technical design, author specifications, review code, mentor engineers, ensure SDLC, audit/security compliance, and drive technical strategy while collaborating with architects and business partners. Participate in Agile ceremonies, be on-call as needed, and travel occasionally.

Build and maintain production-grade data processing systems and foundational infrastructure for enterprise AI. Collaborate with researchers and engineers, deliver end-to-end implementations, transform unstructured data into performant datasets, and use distributed processing frameworks and modern analytics tooling to inform products and strategy.

Design, build, and maintain data pipelines and a Microsoft Fabric data lakehouse to ingest, transform, and secure large datasets. Collaborate with analysts and Power BI developers, ensure data quality, troubleshoot issues, and optimize cloud-based ETL/ELT and warehousing solutions.

Lead design, build, and operate real-time, Flink-based streaming data platforms. Develop low-latency, stateful pipelines, enforce event schemas/contracts, ensure fault tolerance and observability, mentor engineers, and partner with architecture and compliance teams to deliver resilient streaming solutions for banking use cases.

The Principal Data Engineer will lead data architecture initiatives, design scalable data systems, and oversee data standards across teams while ensuring high-quality data infrastructure and guiding engineering teams.

Design, build, and maintain an internal data platform and pipelines. Ensure secure, governed, resilient data access for engineering and BI teams. Partner with architects, implement automations, support platform consumption, mentor users, and drive continuous improvement and compliance.

Build, maintain, and monitor ETL/ELT pipelines in the Microsoft Fabric ecosystem. Implement medallion architecture, transform raw data into analytics-ready models, ensure pipeline reliability and data quality, troubleshoot failures, optimize performance, and support CI/CD and version control for data artifacts.