Top Senior Data Engineer Jobs in Huntsville, AL

Develops advanced data engineering and visual analytics applications for structured and semi-structured data. Designs enterprise database systems, builds large relational databases, develops and optimizes data pipelines, integrates systems with existing data warehouses, and improves system performance. Requires Java, AWS, ETL, Spark, Scala, SQL, PostgreSQL, NiFi, Informatica, and Linux experience, along with an active Top Secret/SCI-eligible clearance.

Architect, build, and operate scalable data platforms processing billions of daily events through real-time and batch pipelines. Own production reliability, data quality, security, observability, and performance while partnering with engineering, analytics, data science, growth, and business teams. Develop frameworks and datasets, make architectural decisions, evaluate technologies, mentor engineers, and help define the platform roadmap.

Build and guide data platform capabilities supporting marketing, finance, analytics, and data science. Develop data collection, integration, scoring, experimentation, analytics, and infrastructure solutions; contribute code, lead cross-functional technical initiatives, improve system resiliency through incident response, and establish engineering standards. Partner with business and technical stakeholders to define strategy and long-term roadmaps.

Design and lead scalable, secure, highly available database infrastructure for multi-terabyte SQL Server environments. Set technical direction for data architecture, performance, real-time pipelines, security, and growth. Troubleshoot complex production issues, optimize queries and indexes, guide cross-functional projects, mentor engineers, review changes, reduce technical debt, and evaluate emerging technologies. Monitor database health using Splunk, Datadog, and Grafana while influencing engineering and Site Reliability strategy.

Build and operate a large-scale enterprise data platform spanning batch and streaming processing, lakehouse storage, Kafka infrastructure, APIs, observability, and agentic MCP interfaces. Develop reusable ingestion and data-quality frameworks, improve scalability and resilience, establish engineering practices, support production operations, and mentor engineers. The role requires deep ownership of distributed data infrastructure and practical use of AI coding agents.

Design and operate production-grade data pipelines, backend services, APIs, and agentic AI workflows. Build scalable systems that ingest, transform, and operationalize data for customer-facing and internal applications. Translate ambiguous operational workflows into reliable architectures, improve service observability and performance, and own technical decisions across data modeling, system design, security, and compliance.

Own and expand Chicory’s analytical data platform supporting advertising, campaign, financial, product, and publisher reporting. Design BigQuery architecture, build batch and streaming pipelines with Python, SQL, Beam, Dataflow, and Airflow, and develop governed data marts and BI datasets. Establish data quality, observability, reconciliation, access controls, cost management, and engineering practices. Partner with engineering, finance, product, campaign management, sales, and leadership while leading incident recovery and documenting systems.

Leads the architecture, development, operation, validation, and optimization of high-volume ETL and data migration pipelines. Transforms structured and unstructured data from legacy systems into cloud platforms, troubleshoots failures, performs data quality validation, conducts root cause analysis, and documents migration processes. Collaborates with cloud, DevSecOps, database, QA, and product teams while reporting pipeline performance, migration status, and data quality metrics.

Build scalable, secure data pipelines, models, platforms, and governance systems that enable AI applications to access trusted enterprise data. Partner with analytics, marketing, and product teams to translate requirements into technical solutions, independently deliver projects through production, and support sensitive-data security and access controls. Preferred experience includes LLM architectures, cloud data platforms, infrastructure as code, regulated environments, and technical leadership.

Lead technical design and hands-on development of Pantheon’s data platform, extending ingestion, curation, retention services and ML/LLM infrastructure. Mentor engineers, drive architecture and engineering standards, operate in a DevOps model, partner cross-functionally, and participate in on-call support to ensure reliable, compliant data access and analytics.

Lead the design, implementation, and operation of production data pipelines and platform capabilities. Build integrations across APIs, files, CDC, events, cloud services, and internal systems. Improve Snowflake, dbt, and Airflow or Cloud Composer workloads for reliability, scalability, performance, and cost. Establish data modeling, testing, quality, observability, recovery, and orchestration standards. Provide architectural leadership, mentor engineers, document practices, and clarify technical and business trade-offs across teams.

Design and scale lakehouse architecture, streaming and batch pipelines, and reliable data platforms using Kafka, Spark, Airflow, Iceberg, Databricks, and related technologies. Build Medallion-layer data systems, manage open table formats, optimize distributed queries, monitor platform reliability, resolve data quality issues, and collaborate with analysts, data scientists, and product teams.

Provides hands-on technical leadership for foundational data engineering and analytics engineering. Owns multi-year data architecture, production pipelines, dimensional models, and trusted metrics spanning cloud costs, traffic, infrastructure, and AI usage. Designs new datasets integrating cost, utilization, performance, and reliability signals; establishes standards, coaches engineers, aligns stakeholders, and drives adoption across Infrastructure, Finance, Data Science, and Product Engineering.

Design and implement scalable analytics/data models and dbt pipelines, manage Databricks, build dashboards and BI solutions, partner with business stakeholders, support CRM/marketing analytics, and explore GenAI/ML opportunities to deliver reliable, automated data products.

Own and evolve production data systems supporting healthcare, claims, billing, analytics, and reporting. Design resilient ingestion patterns, data contracts, models, schemas, and pipelines that handle incomplete, duplicated, delayed, and changing data. Improve performance, observability, failure handling, retries, backfills, and replay safety. Collaborate with engineering, product, operations, and analytics teams while making architecture decisions and documenting technical changes.

Lead data engineering and machine learning initiatives by designing, architecting, developing, and supporting GCP data pipelines. Create information architecture documentation, estimate and plan technical work, collaborate with project teams and business analysts, and translate requirements into technical designs. Develop Python-based ELT pipelines, optimize BigQuery SQL, support CI/CD, and provide technical leadership to projects and teams.

Leads the architecture, development, and support of enterprise data warehouses, lakehouses, dimensional models, ETL/ELT pipelines, and governed data products using Microsoft Fabric and related tools. Ensures data quality, security, scalability, performance, and reliability for analytics and reporting. Partners with technical and business stakeholders, documents data solutions, guides architecture decisions, mentors team members, and drives continuous improvement of data engineering standards and practices.

Designs and maintains scalable ETL pipelines, data models, integrations, cloud databases, and healthcare data infrastructure. Ensures security, HIPAA/HITRUST compliance, reliability, monitoring, and documentation while collaborating with product, engineering, and clinical teams. Requires strong SQL and Python expertise, modern data warehousing and orchestration experience, cloud platform knowledge, and familiarity with healthcare interoperability and claims data.

Build and scale Benepass’s data platform, including warehouses, replication pipelines, orchestration, dbt transformations, Cube semantic models, and governed analytics infrastructure. Own data quality, security, compliance, reliability, performance, cost optimization, and documentation. Partner with Product, Engineering, Operations, GTM, Finance, analysts, and data scientists to deliver trusted reporting and data solutions. Shape the platform roadmap, mentor colleagues, and drive architectural improvements as a senior individual contributor.

Build and scale Benepass’s data platform, including warehouses, replication pipelines, orchestration, dbt transformations, semantic models, and data quality systems. Own platform reliability, governance, security, performance, cost optimization, and developer experience. Partner with Product, Engineering, Operations, GTM, Finance, analysts, and data scientists to deliver trusted reporting and analytics infrastructure. Shape the data platform roadmap, evaluate new technologies, and mentor cross-functional partners as a senior individual contributor.

Leads the architecture, development, and maintenance of scalable batch and real-time data pipelines, cloud data platforms, ETL/ELT workflows, and ML data infrastructure. Establishes standards for data quality, observability, lineage, governance, security, and modeling. Partners with data scientists, engineers, DevOps, and business stakeholders; evaluates technologies, drives technical initiatives, mentors engineers, and supports production-grade APIs and machine learning pipelines.

Lead Data Engineer responsible for designing, maintaining, and improving data pipelines and platform infrastructure across ingestion, streaming, transformation, and delivery. The role uses Airflow, Spark, Iceberg, Kafka, Flink, dbt, Terraform, and GCP. Responsibilities also include defining data contracts, documenting systems, optimizing performance, reviewing code, supporting access controls and compliance, and collaborating with stakeholders and teammates.

Leads data engineering teams in designing, developing, and supporting scalable batch and streaming data solutions. Responsibilities include data pipeline development, architecture, governance, security, platform optimization, production support, technical mentorship, stakeholder collaboration, and delivery leadership. The role requires hands-on engineering with Python or similar languages, modern data technologies, cloud platforms, DevOps practices, and people-management responsibilities.

Designs and maintains ELT pipelines, warehouse integrations, data models, and data quality processes. Collaborates with data scientists, analysts, engineers, and stakeholders to deliver scalable analytical solutions. Responsibilities include data integration, governance, security, performance optimization, exploratory analysis, visualization, and cloud-based API ingestion. Requires strong SQL, DBT, Snowflake, Azure Data Factory, cloud, and scripting experience, plus leadership and communication skills.

Designs, builds, deploys, and maintains scalable data platforms, warehouses, lakes, ETL/ELT pipelines, and batch or streaming workflows. Optimizes cloud data lake and pipeline performance, manages data governance and lifecycle solutions, and collaborates with multidisciplinary agile teams. The role supports mission-driven client projects involving disparate structured, unstructured, and event-streaming data.