Top Senior Data Engineer Jobs in Louisville, KY

Build and maintain production data pipelines, Airflow DAGs, Snowflake infrastructure, and Data Vault 2.0 models. Ensure data quality, observability, security, governance, reliability, and cost efficiency through automated testing and CI/CD. Lead technical projects end-to-end, collaborate with stakeholders, and support SOX-relevant reporting while developing expertise in commercial insurance data and processes.

Build and operate reliable ETL and ELT pipelines across lakehouse and transactional systems. Develop data models, enforce governance, integrate diverse data sources, and support analytics, APIs, and predictive tools. Monitor performance, data quality, lineage, cost, and uptime while collaborating with data science, AI, product, and innovation teams.

Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.

Design, develop, and optimize enterprise-scale data platforms, pipelines, data lakes, warehouses, and analytical datasets on Azure and Snowflake. Build ETL/ELT processes using ADF, Databricks, PySpark, SQL, Python, and Snowflake. Manage data models, governance, security, quality, CI/CD, cloud migrations, and performance optimization. Collaborate with stakeholders, troubleshoot production issues, document solutions, and support Agile delivery.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Builds and maintains scalable data pipelines, ETL infrastructure, data warehouses, and analytics tools. The role assembles complex datasets, automates processes, optimizes data delivery architecture, and supports cross-functional data initiatives. Collaborates with executive, product, data, and design stakeholders to resolve technical issues and improve analytics systems. Requires proficiency in SAS, Python, Java, MATLAB, SQL, NoSQL, Hadoop, MapReduce, Hive, Presto, UNIX, and Linux, with JavaScript, R, and basic machine learning preferred.

Build and operate batch and near-real-time data pipelines, semantic models, certified measures, APIs, and serving infrastructure for AI-powered decision systems. Responsibilities include data quality, observability, lineage, governance, CI/CD, infrastructure as code, performance optimization, model scoring pipelines, and AI telemetry. Partner with data scientists and business stakeholders to productionize models and deliver reusable, documented data platform capabilities.

Design and build PerfectServe’s unified cloud data platform, including ingestion pipelines, integrations, data models, metrics, and consumer-facing data layers. Establish architecture, engineering, quality, and testing standards; enable safe extraction from production systems; partner with data users; and mentor data engineers. The role requires substantial cloud data platform experience, deep SQL, warehouse expertise, ELT, change-data-capture, AWS, modeling, orchestration, and data quality skills.

Designs, builds, and maintains enterprise data pipelines, ETL processes, integrations, cloud data infrastructure, and complex data models. Supports analytics partners, develops data warehouse solutions, tunes SQL and database performance, troubleshoots production issues, and delivers end-to-end data engineering projects. The role collaborates with architects, analysts, developers, and business stakeholders, applies big data technologies, supports agile delivery, and mentors team members.

Design, build, and optimize scalable ELT pipelines into BigQuery, create dbt models and data models, implement data quality, observability, CI/CD, and IaC practices, and partner with stakeholders to deliver trusted enterprise data products.

Build and manage scalable ETL/ELT pipelines using Microsoft Fabric and Azure Databricks, implement medallion architecture, support data migrations and legacy SSRS decommissioning, develop Power BI data models, and maintain governance, security, and CI/CD practices. The role also supports migration events and modernizes data infrastructure for advanced analytics and reporting.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

Designs and maintains scalable data architecture, warehouses, ETL/ELT pipelines, and data platforms. Responsibilities include ensuring data quality, integrity, governance, accessibility, reliability, and performance; supporting customer onboarding and analytics tools; contributing to architecture and engineering best practices; troubleshooting complex data issues; and participating in on-call rotations. The role collaborates with engineering, product, solutions, business intelligence, and other cross-functional teams in healthcare and social care data environments.

Owns SQL Server and Azure data warehouse health, ETL/ELT pipelines, data modeling, security, and performance. Administers Azure infrastructure, access controls, costs, monitoring, and legacy-system decommissioning. Builds internal applications and automations using AI-assisted development, integrating business systems with trusted data platforms. Partners with BI, IT, and operations teams while applying software engineering, governance, security, and compliance practices.

Own the analytics data layer by translating stakeholder needs into certified dimensional models, governed metrics, semantic layers, dashboards, and reports. Build with dbt, SQL, Databricks, Power BI, and Airflow while ensuring data quality, observability, reconciliation, documentation, and dependable orchestration. Partner closely with finance, operations, and client-facing teams, automate recurring workflows, and use AI-assisted engineering practices in a fully remote environment.

Leads the architecture, development, and maintenance of scalable batch and real-time data pipelines, cloud data platforms, ETL/ELT workflows, and ML data infrastructure. Establishes standards for data quality, observability, lineage, governance, security, and modeling. Partners with data scientists, engineers, DevOps, and business stakeholders; evaluates technologies, drives technical initiatives, mentors engineers, and supports production-grade APIs and machine learning pipelines.

Designs and operates an AWS-native lakehouse supporting analytics, reporting, visualization, and AI/ML. Builds batch and streaming ingestion pipelines using Python and PySpark, Apache Iceberg data structures, governance and metadata services, quality controls, security, observability, and CI/CD automation. Optimizes performance, scalability, reliability, and cost while collaborating with cross-functional technical teams and documenting architecture, operations, and secure configurations.

Lead design, build, and operate scalable Databricks/Delta Lake data pipelines and Kimball dimensional models using dbt. Manage governance with Unity Catalog, optimize performance and cost, operationalize ML with MLflow, and coordinate/quality-check offshore vendor engineering. Mentor engineers, uphold standards, and deliver trusted data products that power analytics, reporting, and MLOps workflows.

Provides hands-on technical leadership for foundational data engineering and analytics engineering. Owns multi-year data architecture, production pipelines, dimensional models, and trusted metrics spanning cloud costs, traffic, infrastructure, and AI usage. Designs new datasets integrating cost, utilization, performance, and reliability signals; establishes standards, coaches engineers, aligns stakeholders, and drives adoption across Infrastructure, Finance, Data Science, and Product Engineering.

Designs, develops, and maintains Databricks-based ETL pipelines, data integration solutions, data warehouses, and reporting datasets. Builds batch and streaming architectures using Python, Spark, SQL, and Delta Lake; optimizes performance and costs; migrates legacy SSIS and SQL Server processes; maintains SSRS reports; implements data quality controls; and collaborates with business and technical teams supporting analytics and AI/ML workloads.

Leads and develops the Data Engineering team while remaining hands-on with scalable pipelines, ETL/ELT processes, data warehouses, integrations, and infrastructure. Establishes architecture, reliability, quality, and performance standards; guides technical strategy; improves automation and monitoring; and partners with Finance and business stakeholders to translate data needs into practical solutions.

Designs, develops, and maintains Databricks-based ETL pipelines, data lake architectures, datasets, and data warehouses supporting reporting, analytics, and AI/ML workloads. Troubleshoots and optimizes Databricks and SSIS processes, maintains SSRS reports, implements data quality controls, migrates legacy systems, and collaborates with business and technical teams. The role also promotes AI-assisted development practices and documents technical procedures.

Build and operate core data infrastructure for edge and hybrid environments, including ingestion, OT/IoT integrations, real-time streaming, data contracts, schemas, validation, lineage, observability, telemetry, and scalable query access. The role requires production ownership, reliability practices, customer integration, and collaboration across engineering and customer-facing teams. Candidates should have 6+ years of experience with production data, streaming, or integration systems and proficiency in Python and/or Go.