Top Data Engineer Jobs in Birmingham, AL

Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.

Build and manage HR data pipelines, ETL/ELT processes, data warehouse models, and analytics workflows across cloud platforms. Ensure data quality, governance, security, and availability for People Analytics and HR stakeholders. Lead and mentor data engineers, collaborate with business and IT teams, and support reporting and analysis using tools such as Python, R, and business intelligence platforms.

Develop and manage HR data pipelines, ETL processes, warehouse models, and data transformations for People Analytics. Integrate data from Workday, payroll, talent management, and other systems while ensuring quality, security, governance, and compliance. Mentor data engineers, support reporting workflows in Python and R, and collaborate with HR, IT, and business stakeholders to deliver reliable analytics solutions.

Designs, builds, and maintains cloud data pipelines, storage systems, and reusable infrastructure for data and analytics initiatives. Develops scalable ETL processes using cloud big data tools, supports feature engineering and machine learning deployment, and builds AI-integrated applications. The role also involves data modeling, governance, cybersecurity compliance, process improvement, technical project leadership, mentoring, and delivering enterprise data assets in a regulated financial services environment.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Staff Data Engineer responsible for setting technical direction, architecting scalable data platforms, leading cross-functional initiatives, improving reliability and performance, and enabling AI-assisted analytics and development. The role includes hands-on development with Python, SQL, cloud data warehouses, orchestration, infrastructure as code, Kubernetes, Kafka, and streaming pipelines, along with mentoring, technical advocacy, documentation, code reviews, and on-call troubleshooting.

Staff Data Engineer leading architecture and technical direction for real-time and batch motorsports data platforms. Responsibilities include telemetry ingestion, streaming systems, data quality, observability, cloud platforms, reliability, incident response, technical standards, roadmap planning, stakeholder influence, and mentoring. The role delivers scalable solutions supporting race-day operations and cross-functional analytical products.

Leads enterprise data platform architecture, engineering standards, technical decisions, and development of scalable data products. Designs batch and streaming systems, governance, observability, security, and reliability practices. Partners cross-functionally, mentors engineers, drives modernization and migrations, and establishes reusable patterns for data modeling, orchestration, quality, and platform operations.

Designs and optimizes scalable data infrastructure, including ETL pipelines, data integrations, BI solutions, validation, cleansing, workflow optimization, and troubleshooting. The role supports clinical and operational teams by integrating data from clinical systems, APIs, warehouses, and external sources while ensuring data quality and performance. Collaboration across departments and delivery of data-driven insights are key responsibilities.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Design and maintain Snowflake-based data platforms, cloud-native data lakes, and scalable ETL/ELT pipelines for asset-backed finance analytics. Orchestrate workflows with Dagster and AWS services, ensure data reconciliation and integrity, and support migration from legacy systems. Contribute to project planning, Jira backlog management, testing, cutover planning, and cross-functional go-live readiness.

Design and maintain Snowflake data pipelines and data lake architectures for asset-based finance analytics. Develop ETL/ELT workflows, validate and reconcile financial data, migrate legacy systems, and translate quantitative finance logic into scalable architectures. Support project execution through requirements breakdown, planning, testing, cutover, and go-live readiness. Collaborate across engineering, quantitative analytics, and stakeholder teams.

Design, build, and operate production data pipelines and shared data foundations using SQL, Python, PySpark, Databricks, and cloud technologies. Develop data models, ingestion and transformation workflows, resilient processing, observability, data-quality controls, and secure customer-aware data flows. Collaborate with engineering and product teams, evaluate architecture and tooling, support analytics and application services, contribute to testing and documentation, and mentor other engineers.

Builds and maintains data pipelines and datasets supporting analytics, AI, and modeling. Responsibilities include ingesting healthcare claims and lab data into Snowflake and AWS Iceberg, processing structured and unstructured sources, curating data for AI use cases, implementing medallion architectures, evaluating data quality, and contributing to pilot initiatives using SQL, Python, AWS Glue, Terraform, and Snowflake.

Designs Azure-based data models, simulations, test environments, automated testing frameworks, and performance validation solutions for healthcare data pipelines. Develops test data generators, validates ETL and HL7 FHIR transformations, supports data quality and reliability, and collaborates with engineers and architects on design and code reviews. The role also provides technical guidance on testing architecture, CI/CD, infrastructure as code, resiliency, and large-scale cloud data processing.

Build and maintain production data pipelines and foundational datasets for Market Intelligence. Automate survey ingestion, cleaning, joining, scheduling, monitoring, and reporting-layer integration. Develop repeatable queries, improve data quality practices, document assumptions, support reproducible outputs, and translate research needs into technical solutions. The role requires close collaboration with technical and nontechnical stakeholders and ownership of reliable data infrastructure.

Design, build, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, SQL, Spark, and Delta Lake. Develop transformations, orchestration workflows, data models, validation processes, and curated data products. Troubleshoot performance and quality issues, apply governance and security practices, document solutions, and collaborate with architects, data scientists, DevOps teams, analysts, and clients.

Designs, builds, and maintains Snowflake-based enterprise data warehouse solutions, including data architecture, ETL/ELT pipelines, security, deployment, data quality, modeling, and performance optimization. Partners with integration, analytics, governance, business intelligence, and architecture teams. Supports production operations, resolves ingestion and transformation issues, develops AWS-to-Snowflake scripts, documents implementations, and translates business requirements into scalable data solutions.

Designs, develops, and maintains scalable ETL/ELT pipelines and data platform capabilities for high-volume healthcare data. Responsibilities include complex SQL development, Airflow orchestration, dbt transformations, data quality frameworks, pipeline monitoring, troubleshooting, performance optimization, and documentation. The role collaborates with Data Operations, Product, Analytics, Data Science, and clinical teams to deliver reliable data for analytics, reporting, product features, and AI/ML initiatives.

Design and manage financial systems for accurate cashback calculations, build and maintain reconciliation processes, ensure data integrity for yield-bearing instruments, collaborate with compliance, and partner with cross-functional teams to improve financial system efficiency.

Build and maintain FinOps data pipelines, BigQuery and dbt models, cost attribution systems, forecasting and anomaly detection models, and cost-versus-revenue analytics. Identify and implement AWS and GCP savings opportunities, automate governance with Python, Terraform, and Lambda, and partner with Engineering, Finance, Product, and leadership on cloud costs, forecasting, reporting, and architecture decisions.

Designs, develops, maintains, and improves software applications and business processes. Responsibilities include full lifecycle development, troubleshooting, performance and reliability improvements, CI/CD collaboration, requirements analysis, technology research, package maintenance, portfolio planning, and mentoring junior engineers. The role requires independent work, cross-functional collaboration, and strong software development, documentation, and problem-solving skills.

Build and maintain scalable Python-based data pipelines and cloud-native solutions supporting U.S. Army financial-system modernization. Develop ETL/ELT workflows using AWS Glue, Lambda, S3, and CloudWatch; integrate APIs and diverse file formats; improve data reliability, performance, security, and governance; implement testing and monitoring; and collaborate with engineers and stakeholders in an Agile environment.

Build and own scalable data platforms and ingestion pipelines using BigQuery, dbt, and modern ingestion tools. Design batch and CDC workflows, improve reliability and observability, implement governance and access controls, and support analytics and AI agents. Develop Python services and internal tooling, contribute to architecture and lakehouse experiments, collaborate with stakeholders, and mentor engineers. The role requires strong SQL, Python, cloud infrastructure, testing, CI/CD, and AI-assisted development experience.

Develop and maintain data pipelines, backend programs, and integrations in Azure Government Cloud. Transform and cleanse data, evolve scripts and notebooks, manage relational databases, support data quality, document technical processes, and collaborate with engineers, geospatial experts, scientists, and government clients. The role also involves project coordination, status reporting, client travel, and compliance with government background and security requirements.