Top Data Engineer Jobs in Birmingham, AL

Design, implement, and maintain PySpark-based data reconciliation solutions for financial systems. Build matching algorithms, integrate with rules engines, process large distributed datasets, identify and resolve discrepancies, and collaborate with analysts and architects to improve data quality and governance.

Design, implement, and maintain data quality processes using cloud platforms (Azure/AWS/GCP). Collaborate with stakeholders to define standards, perform data profiling and cleansing, document issues and remediation, generate quality metrics, and support cross-functional teams to improve data architectures and integration.

Design, implement, and maintain PySpark applications to automate large-scale financial data reconciliations. Build transformation and matching algorithms, integrate with rules engines, analyze data gaps, and collaborate with analysts and architects to ensure data quality and system resilience.

Design, build, and optimize PySpark applications and ETL pipelines to process large-scale datasets from SQL/NoSQL sources, data lakes, and streaming platforms. Ensure data quality, error handling, performance tuning, and collaborate with analysts, scientists, and architects to deliver scalable data solutions.

Design, develop, test, and deploy high-performance Spark/Scala data processing applications and ETL pipelines using the Cloudera Hadoop ecosystem. Optimize Spark and platform performance, ensure data integrity and security, collaborate with data scientists and analysts, troubleshoot issues, and implement version control and CI/CD for Spark applications.

Design and develop Big Data applications using Java, Spark, and MapReduce on Cloudera/Hadoop ecosystems. Work with Hive, Impala, YARN, Kafka, and large datasets; write tests (JUnit), perform data analysis, and script in Unix/Python. Lead and manage global technology teams and follow industry best practices.

Design and implement big data solutions (Spark, Hive, Java, CDP). Analyze and consolidate disparate data sources, produce functional specifications, review data models, gather stakeholder requirements, validate implementations, support production deployments, investigate data quality and data lineage, and collaborate with technology leads to ensure data completeness and accuracy.

Design, develop, and maintain PySpark applications and ETL pipelines to process, transform, and integrate large-scale datasets from SQL, NoSQL, data lakes, and streaming sources. Optimize Spark job performance, implement robust error handling, and collaborate with data analysts, scientists, and architects using orchestration tools like Airflow or Luigi.

Own the 2-3 year architecture and reliability of high-volume catalog, pricing, and inventory ingestion. Lead migrations from legacy batch to modern systems, define data SLAs, build observability and orchestration, mentor senior engineers, and resolve cross-team, high-severity data problems.

Design, build, and maintain scalable data systems and ETLs on GCP; connect production data to business systems; generate analytics and ML-driven insights for GTM teams; work cross-functionally and introduce modern tools (Airflow, DBT, Presto, Hightouch).

Design, build, and maintain scalable batch and streaming data pipelines, improve data modeling and governance, contribute to enterprise data architecture, and collaborate with cross-functional teams to ensure reliable, high-quality data for analytics and operational use.

Work directly with customers to design, build, and maintain data integrations and pipelines, troubleshoot ingestion/transformation/delivery issues, optimize large-scale data processing, collaborate with data scientists, and guide technical onboarding and long-term success.

Build and maintain production data pipelines and foundations for People Analytics and AI-driven tools. Integrate HR systems (Workday, Greenhouse), design data models, ensure governance for sensitive employee data, support data science and reporting, and deliver dashboards and Streamlit apps. Optimize queries, enable LLM consumption with quality and latency controls, and collaborate cross-functionally to transition AI prototypes to production.

Maintain and build data products, pipelines, and automation to support care management and clinical programs. Integrate multiple data sources into single sources of truth, perform root cause analysis, and serve as a subject-matter expert for partner teams to drive clinical, operational, and financial insights.

The Senior Data Engineer will design scalable data processing frameworks using Java and Apache Spark, manage data pipelines, and mentor junior engineers.

As a Data Engineering Architect, lead the transformation of data engineering into a modern platform, oversee architecture and technical leadership, design scalable systems, ensure data quality and governance, and mentor teams for a data-driven culture.

Design and execute SQL-based ETL processes to migrate legacy public safety data into Mark43. Collaborate with customers, contractors, and internal teams to map legacy schemas, handle edge cases, ensure data fidelity, and improve migration tooling while managing timelines and stakeholder relationships.

Design, build, and maintain an internal data platform enabling secure, governed access for engineering and analytics. Partner with architects, implement data pipelines and automations, enforce security and compliance, support platform services, recommend architecture improvements, mentor teams, and drive adoption of scalable, self-service data capabilities.

As an Associate Engineer in Data Science, you will leverage data analysis and machine learning to solve complex problems and develop inspiring digital products.

Nagarro seeks an Associate Principal Engineer in Big Data to leverage extensive IT experience for strategic organizational value. The role values self-starters and innovation.

Own end-to-end client data migrations: reverse-engineer legacy ETL, design and build Airflow DAGs and Spark jobs, validate and reconcile data at scale, document architecture and decisions, and coordinate cross-functional teams through go-live and hypercare.

Lead a team of data engineers to design, build, and maintain scalable data pipelines, a Data Vault, data warehouses and marts. Own backlog, sprint planning, mentoring, stakeholder collaboration, data validation/monitoring, and platform improvements to deliver key metrics and data infrastructure across the business.

Build and maintain enterprise data platform and ETL/ELT pipelines, design and deploy data models, ensure data quality and governance, integrate third-party sources, and support analytics and AI initiatives across the organization.

Design, deploy, and maintain scalable data infrastructure and orchestration for analytics and ML; write optimized SQL over large warehouses; partner with engineering and product to structure source systems; maintain CDC pipelines; scale reporting and expose analytical datasets enterprise-wide while ensuring data management, security, and compliance.

Design and own end-to-end data platform architecture, build ingestion and transformation pipelines, model multi-tenant datasets, optimize Postgres and ClickHouse performance/cost, implement orchestration and observability, define data quality and reconciliation standards, and mentor data/product engineers.