Top Data Engineer Jobs in Birmingham, AL

Design, build, and maintain scalable ETL/ELT data pipelines on Databricks and AWS S3; manage large geospatial and temporal datasets; productionize ML models; implement data validation, testing, and monitoring; optimize storage and processing; document workflows; collaborate cross-functionally.

The DMS Data Engineer is responsible for analyzing raw data, building data systems and pipelines, conducting complex data analyses, and collaborating on projects to enhance data quality and reliability.

Design, build, maintain, and optimize Spark and Scala ETL/ELT pipelines on AWS for terabyte- and petabyte-scale datasets. Work across S3, Snowflake, Kafka, and monitoring systems, resolve production data-quality and performance issues, write automated tests, participate in architecture and code reviews, and support on-call operations. Use generative AI to improve pipeline development, monitoring, and engineering productivity.

Lead architecture and hands-on engineering to design, scale, and govern a cloud-native lakehouse using Databricks and Microsoft Fabric. Build batch/streaming pipelines, ensure HIPAA-compliant PHI handling, produce analytics-ready datasets, mentor engineers, and drive platform strategy, governance, and reliability.

Design, build, and maintain ETL pipelines, databases, and data models to process healthcare claims and related data. Ensure data quality, analyze claims data for trends, and produce reports and visualizations for nontechnical stakeholders. Collaborate with policy and analytics teams to translate requirements into data solutions and improve data infrastructure and analytics capabilities.

Design and implement end-to-end data solutions on Microsoft Fabric and Azure for insurance datasets. Build ingestion pipelines (batch, streaming, API), Lakehouse architectures, and data models. Enforce governance, security, compliance, and cost/performance optimizations while guiding engineers and stakeholders on architectural best practices.

Develop and maintain large-scale, cloud-native data services and distributed pipelines for multi-tenant healthcare systems. Responsibilities include data modeling, database component development, SQL programming, performance tuning, testing, deployment, code reviews, proof-of-concepts, and full software development lifecycle ownership. Collaborate with global engineering teams, evaluate technologies, apply security and operational requirements, and use AI tools to accelerate development.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.

Build and maintain low-latency, highly available distributed data systems and services to deliver high-quality data for product, analytics, and ML. Partner with data scientists and product teams to design scalable, observable, multi-tenant data products using batch and real-time processing frameworks. Ensure 24x7 reliability, monitoring, and operational excellence while owning end-to-end delivery.

Build scalable, privacy-focused data frameworks and ETL pipelines using big-data technologies (Spark, Presto, Flink, Kafka, Hive). Ensure appropriate handling of personal data, support privacy and legal needs, partner cross-functionally, and lead system design while mentoring teammates.

Design, build, and own large-scale batch and streaming data pipelines and core Ads data products. Collaborate with analytics, data science, and engineering teams to model, transform, govern, and deliver high-quality ad datasets for analysis, ML, and reporting while ensuring privacy compliance.

Designs and leads scalable data platforms, event-driven services, orchestration pipelines, and DataOps practices using Python, Airflow, Snowflake, Kafka, and related technologies. The role establishes engineering standards, governance, security, observability, cost efficiency, and AI-assisted development practices. It also mentors engineers, drives cross-functional initiatives, modernizes data ingestion, and ensures reliable, compliant, and well-governed systems.

Lead database engineering for a federal species-data integration program in a hybrid AWS cloud environment. Responsibilities include harmonizing schemas, documenting source-to-target mappings and lineage, enforcing metadata and data-quality standards, implementing encryption and NIST-aligned security controls, building authoritative source registries, optimizing performance, and leading production migration, validation, monitoring, and operational documentation. The role requires Databricks or equivalent lakehouse expertise, ETL programming, federal governance knowledge, and database migration leadership.

Leads data engineering strategy and mentors an analytics engineering team. Designs scalable ELT pipelines, warehouse integrations, data models, API ingestion workflows, and data quality frameworks using cloud and database technologies. Conducts exploratory analysis, supports dashboards and analytical solutions, monitors warehouse performance and costs, and ensures data governance, security, and compliance. Collaborates with data scientists, analysts, engineers, and business stakeholders to deliver healthcare analytics solutions.

Own SQL and dbt-based data modeling and data quality for clinical and claims datasets. Author and refactor dbt models/tests, triage DQ alerts, design monitors, optimize SQL performance, and collaborate with Data Engineering and stakeholders to ensure trusted production datasets.

The job involves building responsive web dashboards, advanced data visualizations, and analytics tools for unmanned aircraft systems, requiring a deep understanding of UI/UX design and data presentation.

Lead the data engineering strategy and architecture for distributed pharmaceutical data systems. Design and scale pipelines, APIs, and data platforms while ensuring reliability, governance, quality, and PII/PHI protection. Drive technical decisions, improve developer efficiency, deliver business impact, influence cross-functional roadmaps, mentor engineers, communicate with executives, and promote organizational adoption of new technologies and processes.

Design and operate Alpaca’s scalable data platform on GCP, including lakehouse infrastructure, Kubernetes-based deployments, streaming and CDC pipelines, batch ingestion, BI access, cataloging, monitoring, and governance. Build infrastructure as code with Terraform and Ansible, operate distributed query engines and Apache Iceberg, maintain reliability practices, and collaborate with DevOps and analytics teams to support rapidly evolving data requirements.

Develop business intelligence and analytics solutions using financial, operational, RF, and video performance data. Build scalable data models, dashboards, reports, automation workflows, and ETL/ELT processes using Power BI, Tableau, DataMiner, and Qligent. Analyze trends and anomalies, monitor satellite and video delivery performance, translate business requirements into actionable insights, and collaborate with enterprise stakeholders in a fully remote consulting role.

Design, build, and operate scalable cloud-native data platforms and pipelines supporting analytics, reporting, AI, and customer-facing applications. Develop ETL/ELT workflows, data lakes, event-driven streaming solutions, integrations, and data models using Python, SQL, AWS, databases, warehouses, messaging technologies, and orchestration tools. Monitor production systems, optimize performance, automate testing and deployment, and collaborate with engineering, platform, product, and data teams.

Design, build, and operate scalable cloud-native data platforms and pipelines supporting analytics, reporting, AI workloads, and customer-facing applications. Develop ETL/ELT processes, data lakes, event-driven and streaming solutions, data models, enterprise integrations, and automated monitoring and deployment systems. Collaborate with software, platform, product, and data teams to ensure reliable, secure, high-performance production systems.

Designs and builds production data systems, pipelines, database schemas, analytical models, and internal platforms. Responsibilities include writing tested code, optimizing queries and storage, controlling infrastructure costs, enforcing CI/CD, and implementing data testing, monitoring, and alerting. The role also develops AI and LLM-backed data use cases, including retrieval pipelines, embeddings, vector storage, evaluation harnesses, and agentic workflows.

Build and maintain ETL and data pipelines using Python, PySpark, and AWS services. Orchestrate workflows, develop event-driven integrations, optimize data storage and queries, process API and JSON data, and implement data quality monitoring. Support CI/CD, production operations, cloud migration, data lake and lakehouse initiatives, and near-real-time systems while collaborating with stakeholders to deliver technical solutions.

Design, build, and maintain scalable data pipelines, lakes, and infrastructure using Databricks, Spark, Python, and AWS. Collaborate with ML engineers, data scientists, and analysts to deliver data products, ensure data quality and governance, implement DevOps/SDLC practices, mentor junior engineers, and evaluate new data technologies.

Architect, build, and maintain Snowflake-based ELT pipelines and production data models. Implement observability, data quality, and governance; optimize cost and freshness. Partner with Analytics, Product, and Engineering, use dbt/CI-CD and AI-assisted tooling, and participate in reviews and architecture planning to support analytics, BI, and ML.