Top Data Engineer Jobs in Madison, WI

The Data Engineer will build and maintain data pipelines, optimize workflows, manage infrastructure, and enhance pipeline observability while collaborating with teams for effective data delivery.

Design, build, and optimize BigQuery-based data solutions and data models. Manage data storage, partitioning, clustering, ETL, and data quality. Collaborate with architects, data scientists, and engineers to deliver scalable, secure cloud data infrastructure and documentation; senior hires provide technical leadership, code review, and process improvement.

As a Data Engineer, you'll lead data engineering projects, develop data transformations, build workflows with Apache Airflow, and ensure data quality and integrity while collaborating with stakeholders.

Build and maintain reliable data pipelines, Airflow DAGs, and Snowflake-based Data Vault/warehouse models. Implement CI/CD, automated testing, observability, and production support while partnering with stakeholders and developing insurance domain expertise.

Lead design and implementation of shared, reusable analytics data models and pipelines. Drive standardization, governance, observability, and CI/CD for analytics; partner with Data Science, Infrastructure, and Product to certify metrics, modernize orchestration, and integrate AI-native tooling.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Build user-facing data products by transforming internal data into actionable metrics. Collaborate with platform teams and data scientists to prototype, validate, and prioritize data sources. Write requirements and proposals, engage in user research, and deliver performant Python/SQL-based data features using Databricks and Postgres.

As a Senior Data Engineer at Jellyfish, you'll build and maintain data pipelines, optimize orchestration, automate CI/CD processes, and enhance data integration while ensuring high performance and reliability.

Build and maintain scalable, governed data pipelines from ingestion through transformation and integration. Implement schema validation, data quality checks, job monitoring, and production-grade APIs. Work with Python, SQL, Airflow, dbt, AWS (EMR, Athena, S3), Iceberg/Parquet, and contribute to CI/CD, observability, and on-call support while collaborating with analytics and product teams.

Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.

Design, build, and optimize scalable batch and real-time data pipelines; develop ETL/ELT workflows; manage and tune cloud data warehouses; automate infrastructure with Airflow and IaC tools; deploy with containerization and orchestration; collaborate with data scientists and analysts; monitor, troubleshoot, and enforce data governance and security.

As the first in-house Data Engineer, you will own the data infrastructure, build and maintain data pipelines, and collaborate with teams to ensure quality data access and insights.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Design, develop, test, maintain, and support secure, scalable data solutions using Snowflake and Databricks. Lead technical design, author specifications, review code, mentor engineers, ensure SDLC, audit/security compliance, and drive technical strategy while collaborating with architects and business partners. Participate in Agile ceremonies, be on-call as needed, and travel occasionally.

Design, build, and maintain scalable ETL/ELT pipelines ingesting travel-related data from multiple sources. Integrate and model data in cloud warehouses (Snowflake/BigQuery/Redshift), implement data quality and monitoring, support real-time streaming, and ensure data governance and regulatory compliance. Collaborate with analysts, data scientists, and product teams to deliver reliable datasets for personalization, forecasting, and optimization.

Design, build, and maintain scalable data lakes, databases, and ingestion pipelines for credit and lending data. Ingest and map external financial datasets, implement monitoring and alerting, translate stakeholder needs into data flows, and deliver analytical insights that drive product quality and business value.

Design, implement, and optimize Snowflake data storage and ETL solutions. Write and tune SQL, integrate data sources and BI tools, ensure data security and compliance, and collaborate with teams to meet business objectives.

Design, build, and maintain scalable data pipelines and ETL/ELT frameworks using Python and PySpark. Develop reusable components, microservices, and cloud-based data solutions on AWS and Snowflake. Ensure code quality via reviews, CI/CD, logging, and best practices while collaborating with stakeholders to solve data problems.

Design, build, and maintain scalable data pipelines and models using Databricks, dbt, and PostgreSQL. Develop AWS-based data solutions (Redshift, RDS, S3, Glue, Lambda, DMS), implement ETL/transforms in Python and Java, use Terraform for IaC, monitor with CloudWatch and Splunk, perform code reviews, and collaborate with stakeholders in agile teams to deliver reliable data systems.

Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

Lead design and delivery of scalable data lakes, warehouses, and pipelines. Define governance, quality, monitoring, and CI/CD. Build real-time streaming systems and production AI/ML data flows (embeddings, vector stores, RAG, feature stores). Mentor engineers, set platform strategy, and drive data platform modernization.

Build and operate data-intensive web products and APIs, extend high-throughput ETL pipelines and scrapers, ensure reliability/observability, design self-scaling services, participate in code review, and collaborate across product, data, and infrastructure teams to meet production SLAs.

Develop and maintain Python-based data applications and pipelines: fetch data from databases/APIs/files, build Pandas DataFrames/NumPy arrays, write complex SQL and data transformations, handle nested JSON, and collaborate with data science teams to deliver production data platforms.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).