Top Senior Data Engineer Jobs in St. Louis, MO

The Data Engineer is responsible for designing data workflows and pipelines, implementing systems engineering principles, and deploying data streaming technologies while ensuring compliance with industry regulations and best practices.

Forward-deployed senior data engineer who deploys, hardens, integrates, and operates a data platform (lakehouse, streaming, governance) in DoD environments. Build pipelines across classification boundaries, produce accreditation evidence (STIG/cATO/FIPS), run day-2 operations, train mission teams, and mentor junior FDEs while feeding field feedback into product improvements.

Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Design, build, and maintain scalable ETL and data pipelines on AWS using Python/PySpark. Develop Glue/Lambda/Step Function workflows, event-driven integrations, and data lake/warehouse solutions. Tune SQL, implement monitoring/validation, support API/JSON integrations, troubleshoot operations, document and automate deployments, and mentor junior engineers.

Design and implement scalable data pipelines and orchestration on GCP to support AI/ML-driven mail intelligence. Build stream and batch processing, ensure data governance and quality, optimize workflows, create visualizations, and collaborate with US cross-functional teams to align technical strategy and recover from failures.

Design, develop, maintain, and optimize ADABAS database structures and data solutions. Support mainframe data processing (Natural, COBOL, JCL), perform migrations to modern platforms, tune performance, ensure data integrity/security, troubleshoot issues, and collaborate with developers, architects, and analysts on modernization, API/cloud integration, and data warehousing initiatives.

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

Owner of data platform modernization: design and migrate legacy systems to Kimball-style dimensional models and star schemas; build reliable production data pipelines; enforce data hygiene and validation; champion dbt best practices; mentor junior engineers; collaborate with analysts and stakeholders to ensure scalable, well-documented data models and platform observability.

Design and build scalable data architectures and ETL pipelines to support cloud migrations. Develop batch and real-time data processing, ensure data quality and security, monitor and optimize pipelines, troubleshoot migration issues, document processes, and collaborate with cross-functional teams within Agile frameworks.

Analyze large and diverse datasets to uncover insights, develop/train/deploy machine learning models, design data preprocessing pipelines, and create visualizations and reports. Collaborate with cross-functional teams to build predictive models, recommendation systems, and optimization algorithms to drive business improvements.

Consult with customers to design and implement scalable, secure enterprise geospatial database solutions using Esri/ArcGIS technologies. Configure and maintain database environments (backup, HA/DR), monitor and tune performance, implement security and access controls, automate data workflows, and provide technical guidance across requirements, design, build, and deployment phases. Support integration with ArcGIS web, desktop, and mobile applications for Defense and Intel clients.

Design, build, and maintain Finance data models and scalable data pipelines on GCP. Automate workflows (Python, Airflow/Astronomer, Jenkins), ensure data governance and lineage, collaborate with stakeholders, conduct code reviews and testing, and evaluate new data sources and technologies to support financial insights.

Design, build, and operate scalable PostgreSQL databases and cloud-native data infrastructure. Build and maintain ETL/ELT pipelines, optimize query and server performance, ensure high availability and disaster recovery, improve observability, troubleshoot production issues, guide schema and application design, evaluate database technologies, and mentor junior engineers to support reliable, secure data-driven applications.

Lead design and scaling of the data platform and analytics pipelines. Build and maintain ETL/ELT workflows, integrations, serverless data services, and reliable data models. Mentor teammates, improve automation, observability, and data governance to support analytics and operational insights.

Design, build, and maintain ingestion and transformation pipelines for a knowledge-graph analytics platform. Profile and prepare structured and semi-structured source data, ensure data lineage and traceability, implement transformation logic for graph loading, collaborate with data scientists on graph modeling and entity resolution, improve pipeline reliability, and document ingestion patterns using version control and issue tracking.

Own and evolve the data infrastructure powering identity and fraud products. Build and operate scalable ETL/ELT pipelines, ensure data quality and observability, optimize storage and access, support product squads, respond to production incidents, mentor engineers, and drive data platform innovation.

Lead the Data Platform Engineering team owning ETL/reverse-ETL pipelines, replication, and production datastores. Define architecture, roadmap, standards (IaC, observability, schema contracts), mentor engineers, drive incident response and durable fixes, and partner on cross-team technical decisions and operational reliability for data correctness, completeness, and timeliness.

Own and optimize data infrastructure and ETL/ELT pipelines using SSIS and Microsoft Fabric. Build and maintain SQL Server data warehouse staging, transformations, and lakehouse ingestion. Implement CI/CD, version control with GitHub, monitor pipeline health, troubleshoot data issues, document data flows, and translate stakeholder requirements into data engineering solutions that support BI reporting.

The Senior Data Engineer will design and implement scalable data models in BigQuery using dbt for analytics and reporting, ensuring data governance and optimal performance.

Build and maintain production-grade data pipelines and ELT processes using Python, SQL, Airflow, and dbt within AWS. Design optimized schemas in PostgreSQL and Redshift, leverage AI/LLMs to improve development, automation, testing, and data quality, and scale infrastructure for large healthcare datasets.

Lead architecture and buildout of a new graph-backed enterprise data platform: design ingestion, graph and relational storage, entity resolution pipelines, temporal models, ETL/ELT pipelines, governance, APIs, and production connectors. Ship scalable graph data models, traversal queries, and platform roadmap while enabling observability, security, and containerized deployments.

Lead architecture and reliability of the data platform, build and harden ingestion (batch and CDC), own BigQuery+dbt transformations, establish testing/observability/governance, mentor engineers, develop Python tooling and APIs, run POCs for lakehouse/open table formats, and define AI-assisted development practices.

As a Data Engineer, you will develop solutions for customer-centric technology, ensuring platform integration and managing data architecture. Responsibilities include building data processes, maintaining data integrity, and collaborating cross-functionally to meet business challenges.

Design, build, and maintain ETL/ELT pipelines and API integrations to ingest, cleanse, transform, and analyze infrastructure and cloud data. Produce analytics, dashboards, and executive reports; automate workflows and support near-real-time processing. Follow SDLC/DevOps practices (Git, CI/CD), ensure data governance, quality, lineage, and support incident, release, and compliance activities.