Top Senior Data Engineer Jobs in Huntsville, AL

Develops scalable data and software systems using Python and Apache Spark. Designs APIs, data models, ETL workflows, orchestration, and data interactions while optimizing performance, scalability, integrity, and security. Builds user interfaces, contributes to automated testing, applies Agile practices, and supports CI/CD delivery. The role requires strong software engineering, distributed computing, analytical, and communication skills, with AWS, R, Databricks, and SAS experience preferred.

Lead production of federal species range maps for marine and anadromous taxa. Aggregate, normalize, transform, and validate spatial data; analyze habitat intersects; coordinate iterative reviews with FWS and NOAA SMEs; prepare QA documentation; and secure government sign-off for map deliverables.

Build and operate reliable ETL and ELT pipelines across lakehouse and transactional systems. Develop data models, enforce governance, integrate diverse data sources, and support analytics, APIs, and predictive tools. Monitor performance, data quality, lineage, cost, and uptime while collaborating with data science, AI, product, and innovation teams.

Build and maintain automated ETL/ELT data pipelines, improve data quality and monitoring, optimize Postgres and BigQuery schemas and queries, develop internal tooling, support data governance (HIPAA), participate in on-call rotation, and collaborate across engineering teams to scale data systems.

Designs, builds, and maintains enterprise data pipelines, ETL processes, integrations, cloud data infrastructure, and complex data models. Supports analytics partners, develops data warehouse solutions, tunes SQL and database performance, troubleshoots production issues, and delivers end-to-end data engineering projects. The role collaborates with architects, analysts, developers, and business stakeholders, applies big data technologies, supports agile delivery, and mentors team members.

Design and build a durable data storage platform that preserves source disagreements, provenance, uncertainty, historical versions, and evidence. Develop result and evidence stores, lineage tracking, versioned rules and configurations, reproducible decision records, and point-in-time entity views. Collaborate with entity-resolution and machine-learning teams to support probabilistic outputs. The role requires production data engineering experience, strong Python and SQL, PostgreSQL expertise, U.S. citizenship, and an active Secret clearance.

Designs and implements scalable software solutions, develops maintainable features, resolves bugs, optimizes performance, and writes automated tests. Participates in architecture discussions, code reviews, Agile planning, CI/CD, observability, and adoption of AI-assisted engineering tools. Collaborates with QA, Product Management, and DevOps to deliver software across web, desktop, cloud, and IoT environments. The role is remote for candidates in the Seattle or Los Angeles metropolitan areas, with quarterly travel to Los Angeles.

Own and evolve end-to-end data pipeline architecture across ingestion, transformation, modeling, and serving. Lead platform improvements for cost efficiency, reliability, access control, observability, orchestration, CI/CD, and developer experience. Drive complex cross-team initiatives, resolve production issues, influence architectural decisions, mentor engineers, and build automation incorporating AI into data engineering workflows.

Leads architecture and hands-on development of scalable data pipelines, governed data models, semantic layers, analytics products, and AI workflows. Writes production SQL and Python, establishes engineering standards, mentors engineers, and drives design reviews. Builds agentic and LLM solutions using retrieval and managed AI services while ensuring data quality, observability, reliability, privacy, and regulatory compliance for PHI and genomic data. Partners with stakeholders, platform teams, and governance forums to deliver trustworthy business solutions.

Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.

Build and maintain production data ingestion, transformation, and pipeline systems for a governed federal data and AI platform. Develop data products, contribute to Terraform infrastructure and CI/CD, monitor quality and reliability, troubleshoot issues, and apply governance and access controls. Support data science and ML teams while operating within FedRAMP, NIST 800-171, and CUI requirements. Collaborate with engineers and document pipelines and processes.

Designs and maintains scalable Databricks data pipelines on AWS, covering ingestion, transformation, streaming, data quality, and analytics-ready dataset delivery. Builds medallion architecture layers using Spark, Python, SQL, Delta Lake, and AWS services. Responsibilities include source-to-target mapping, unit testing, CI/CD deployment, anomaly analysis, and compliance with FISMA High and multi-tenant governance requirements. Collaborates in Agile teams and uses AI automation tools to accelerate pipeline development and validation.

Designs and operates data infrastructure for a clinical trial platform. Builds pipelines that extract, normalize, validate, and link information from clinical documents and publications into Aurora and GraphDB. Develops embeddings, vector search, RAG workflows, data-serving APIs, lineage tracking, and regulatory audit trails. The role also requires AWS-based orchestration, clinical data quality controls, biomedical knowledge graph modeling, and deployment automation using infrastructure-as-code and containerization.

Designs and maintains scalable data pipelines, warehouse models, and analytics solutions. Builds natural-language data interfaces using GenAI and LLM techniques, optimizes SQL, improves data quality and observability, and supports distributed data platforms on AWS or GCP. Partners with engineering, analytics, business, and product teams, contributes to shared codebases, establishes development standards, and participates in production on-call and incident response.

Manage the health, performance, reliability, and cost of customer Snowflake and Databricks environments. Responsibilities include customer onboarding, account and warehouse setup, permissions, data ingestion, query optimization, cost reporting, incident response, escalation support, and automation using Python and Terraform. The role also advises customers and internal teams on data platform best practices and participates in on-call rotations.

Build and maintain data lakes, data warehouses, and modern data pipelines for a multi-tenant SaaS platform. Design end-to-end data processes, write pipeline and infrastructure code, conduct design reviews, optimize performance, monitor systems, support data governance, and troubleshoot scalability and security issues. Collaborate with technical and business stakeholders, mentor junior engineers, evaluate technologies, document platform architecture, automate testing, and participate in on-call rotation.

Own the architecture, roadmap, and operation of Clarium’s AWS-based data platform. Build reliable batch and near-real-time pipelines, model healthcare supply chain data, optimize Postgres and Snowflake performance, and establish standards for testing, deployment, quality, and governance. Partner cross-functionally to create durable data models, lead multi-quarter initiatives, manage sensitive data controls, and mentor engineers.

Leads and mentors the Data Engineering team while remaining hands-on in designing, building, and maintaining scalable data pipelines, warehouses, integrations, and infrastructure. Establishes architecture, reliability, quality, and performance standards; guides technical delivery; and resolves complex issues. Partners with Finance and business stakeholders to translate data needs into practical solutions, sets technical direction, evaluates technologies, and communicates strategy, risks, and recommendations to leadership.

Leads and delivers complex data engineering projects, designing scalable data infrastructure, pipelines, warehouses, and data quality solutions. Recommends tools and architectures, optimizes data movement and performance, collaborates across technical teams, mentors engineers, and translates technical concepts for clients and nontechnical stakeholders. The role may also involve real-time processing, data modeling, transformation, security, and MLOps.

Build and operate core data infrastructure for edge and hybrid environments, including ingestion, OT/IoT integrations, real-time streaming, data contracts, schemas, validation, lineage, observability, telemetry, and scalable query access. The role requires production ownership, reliability practices, customer integration, and collaboration across engineering and customer-facing teams. Candidates should have 6+ years of experience with production data, streaming, or integration systems and proficiency in Python and/or Go.

Lead the architecture, development, and optimization of Snowflake and enterprise data platforms. Design scalable ETL/ELT pipelines, dimensional data models, and medallion architectures while establishing engineering standards for testing, deployment, monitoring, security, and data quality. Partner with stakeholders on technical roadmaps, mentor engineers and analysts, conduct design and code reviews, modernize legacy pipelines, and deliver reliable, reusable data solutions.

Design and build PerfectServe’s unified cloud data platform, including ingestion pipelines, integrations, data models, metrics, and consumer-facing data layers. Establish architecture, engineering, quality, and testing standards; enable safe extraction from production systems; partner with data users; and mentor data engineers. The role requires substantial cloud data platform experience, deep SQL, warehouse expertise, ELT, change-data-capture, AWS, modeling, orchestration, and data quality skills.

Build and manage scalable ETL/ELT pipelines using Microsoft Fabric and Azure Databricks, implement medallion architecture, support data migrations and legacy SSRS decommissioning, develop Power BI data models, and maintain governance, security, and CI/CD practices. The role also supports migration events and modernizes data infrastructure for advanced analytics and reporting.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.