Top Data Engineer Jobs in Birmingham, AL

The Data Engineer will develop and maintain data pipelines, perform data extraction and transformation, and support data analytics across the enterprise.

Build and own Snout’s data foundation, including PostgreSQL and dbt warehouses, ingestion pipelines, dimensional models, data quality, documentation, and reliable rebuilds. Reconcile data from veterinary practice-management systems, support LLM/AI tooling, translate stakeholder needs into technical plans, and establish the foundation for a future data team and analyst.

Design, develop, and operate large-scale data ingestion, transformation, enrichment, and processing pipelines across cloud, hybrid, and on-premises environments. Build distributed services using Java, Python, and Kafka; optimize data models and platform performance; deploy applications on Kubernetes; support infrastructure automation and CI/CD; troubleshoot production systems; and collaborate with customers and solution architects on implementations.

Designs, builds, and operates scalable batch and streaming data pipelines on Databricks for federal missions. Responsibilities include developing Spark and Delta Lake solutions, managing clusters and workflows, implementing Unity Catalog governance and security, optimizing ETL/ELT processes, integrating CI/CD, supporting machine learning and advanced analytics, monitoring data quality, and collaborating with technical teams and stakeholders.

Build and maintain production data ingestion pipelines, transformation models, warehouses, and schemas for PerfectServe’s data platform. Deploy reliable, tested pipelines using idempotency and data-quality checks, apply dimensional and medallion modeling, participate in design reviews, and document owned pipelines and runbooks. The role requires SQL, programming experience, dbt or similar transformation tools, cloud data warehouse experience, ELT orchestration, AWS knowledge, and a strong data-testing mindset.

Build and maintain production data pipelines, transformations, governed data products, and cloud data infrastructure for a federal background investigation platform. Develop Python and SQL workflows, contribute to Terraform and CI/CD, monitor data quality and reliability, support data science and ML teams, and operate within FedRAMP, NIST 800-171, and CUI requirements. Collaborate with engineering teams, troubleshoot platform issues, and document processes in a highly regulated environment.

Design, develop, and maintain Customer Data Platform solutions and data pipelines to create unified customer profiles, manage identity resolution, enable audience segmentation and activation, ensure data quality and governance, and support integrations with marketing, CRM, and cloud data systems.

Leads and develops a data engineering team implementing Navigate360 integrations for partner campuses. Oversees integration design, data mapping, validation, reconciliation, quality controls, delivery planning, and scalable implementation processes. Partners with Product, Launch, and Partner Success teams to resolve technical and partner challenges, improve adoption, manage project health, and ensure reliable outcomes. Provides technical mentorship, code and design review, stakeholder communication, and continuous process improvement.

Design, build, and own business-critical data pipelines and infrastructure across warehouses, orchestration, BI, and multiple regions. Develop AWS Glue and Spark jobs, data models, event contracts, observability, and batch or streaming architectures. Collaborate across producer and consumer teams, support Federal workloads, and operate production data platforms in government cloud environments.

Design, build, and scale data pipelines, ETL workflows, analytics infrastructure, and machine-learning data systems. Ensure data quality, security, monitoring, and reliability while optimizing storage and processing performance. Collaborate with engineering, product, and analytics teams on data requirements, modeling, schemas, and scalable infrastructure. The role also establishes data engineering best practices and supports a data-driven culture.

Designs and develops data infrastructure, ETL pipelines, prototypes, and enterprise data assets supporting analytics and Data Science. Partners with business users, data scientists, and analytic engineers to deliver solutions from ideation through implementation. Responsibilities include data exploration, testing, validation, monitoring, predictive-modeling support, data visualization, and functional test execution. Provides technical guidance and mentors team members while promoting innovation and process improvement.

Lead the design and development of Azure-based big data solutions, including batch and real-time ETL/ELT pipelines, data architecture, ingestion, curation, warehousing, and storage. Build solutions using Azure Data Factory, Databricks, Synapse, Spark, Python, SQL, and related Azure services. Support Salesforce migration and integration while applying strong RDBMS, data management, and big data design expertise.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Lead the architecture and development of Vercel’s next-generation data platform, supporting batch and real-time integrations, analytics, data warehousing, and AI/ML workloads. Design scalable systems using Kafka, ClickHouse, Tinybird, and Snowflake; establish data governance and security standards; guide architectural decisions and roadmaps; collaborate with engineering, product, security, compliance, and leadership teams; write production code; and mentor engineers.

Design, develop, and maintain scalable ETL/ELT data integration pipelines supporting analytics, reporting, and product capabilities. Build ingestion, transformation, validation, and curated data layers; optimize production workflows; document systems; and implement data quality monitoring and testing. Collaborate with implementation, engineering, analytics, and customer success teams to resolve data issues, support onboarding, and ensure reliable, accessible data.

Architect and lead enterprise data platforms, pipelines, and infrastructure using Spark, Databricks, and cloud technologies. Build scalable data models and dimensional schemas, establish governance and data quality frameworks, optimize performance and reliability, and implement monitoring. Partner with stakeholders to translate requirements into technical solutions, lead design reviews, mentor engineers, contribute to platform strategy, troubleshoot complex failures, and support hiring and team development.

Build and maintain scalable ETL/ELT pipelines, integrate travel and customer data from internal and external systems, develop cloud data warehouse models, implement data quality monitoring, support real-time streaming, and ensure data privacy and regulatory compliance. Collaborate with analysts, data scientists, and product teams to deliver reliable datasets for personalization, forecasting, pricing, route optimization, and customer experience initiatives.

Build and maintain Google Cloud data pipelines and ETL/ELT processes supporting GenAI and RAG solutions. Classify and govern sensitive data using Dataplex and Cloud DLP, enforce access controls, assess AI readiness, and design reusable schemas and data models. Collaborate with engineering, delivery, and client teams to integrate legacy systems, monitor pipeline reliability, conduct data quality testing, document data flows, and proactively identify compliance and delivery risks.

Designs, builds, and maintains scalable ETL and data processing pipelines supporting analytics, forecasting, risk, and customer insights. Leads complex SQL development, data modeling, governance, quality, lineage, security, and compliance. Partners with engineering, finance, sales, compliance, product, analysts, and data scientists to translate requirements into reliable workflows. Evaluates emerging technologies, leads proof-of-concepts, and develops automated solutions using Python, Spark, Databricks, cloud platforms, orchestration tools, and modern data warehouses.

Leads the design, development, optimization, and migration of modern data platforms in Snowflake. Builds pipelines with dbt, Python, and cloud services; gathers client requirements; creates solution designs and project plans; advises on Snowflake performance, cost, security, and workload management; integrates BI, governance, and AI/ML tools; contributes to accelerators and mentors junior engineers. The role is remote, client-facing, consultative, and focused primarily on technical delivery rather than sales.

Build and operate batch and streaming data pipelines, ETL/ELT workflows, data warehouses, dimensional models, and reusable data services. Improve reliability, performance, quality, and cost efficiency through monitoring, testing, automation, and incident response. Partner with analytics, data science, product, business, platform, and infrastructure teams to deliver production data solutions and roadmap initiatives. Apply AI-assisted tools responsibly to development, testing, documentation, and troubleshooting.

Own and operate the Snowflake warehouse and Sigma semantic layer; manage ingestion (Fivetran), dbt model scoping and review, reverse-ETL, data quality SLAs, dashboards, month-end financial analytics, vendor management, and automation to support AdOps, Sales, Finance, and executive reporting.

Build and maintain Databricks-based data platforms, including ingestion, transformation, storage, governance, data modeling, and serving pipelines. Establish medallion architecture standards, canonical data models, quality controls, lineage, schema evolution, and reliable batch or incremental processing. Improve pipeline observability, scalability, idempotency, and recoverability while moving curated data to systems such as ClickHouse. Collaborate across application and analytics teams to create durable, governed production datasets.

Build and operate scalable batch, streaming, and event-driven data pipelines, cloud data platforms, trusted data products, and analytical models. Improve data quality, observability, reliability, performance, and cost efficiency while supporting risk, finance, product, analytics, and AI initiatives. Partner cross-functionally, influence architecture, lead complex technical initiatives, mentor engineers, and establish strong engineering practices including testing, CI/CD, governance, and infrastructure automation.

Designs and advances Providence’s enterprise data platform through data architecture, governance, metadata management, Snowflake modernization, legacy migrations, and scalable integration patterns. Establishes engineering, DataOps, CI/CD, repository, and data quality standards while supporting analytics, reporting, AI, and data products. Collaborates across multidisciplinary teams to implement large-scale data initiatives in a healthcare environment.