Top Senior Data Engineer Jobs in St. Louis, MO

Design, build, and optimize PySpark applications and ETL pipelines to process large-scale datasets from SQL/NoSQL sources, data lakes, and streaming platforms. Ensure data quality, error handling, performance tuning, and collaborate with analysts, scientists, and architects to deliver scalable data solutions.

Design, develop, test, and deploy high-performance Spark/Scala data processing applications and ETL pipelines using the Cloudera Hadoop ecosystem. Optimize Spark and platform performance, ensure data integrity and security, collaborate with data scientists and analysts, troubleshoot issues, and implement version control and CI/CD for Spark applications.

Design, develop, and maintain PySpark applications and ETL pipelines to process, transform, and integrate large-scale datasets from SQL, NoSQL, data lakes, and streaming sources. Optimize Spark job performance, implement robust error handling, and collaborate with data analysts, scientists, and architects using orchestration tools like Airflow or Luigi.

Design, develop, and maintain scalable ETL/ELT pipelines and Snowflake data models; optimize performance; ensure data quality and integrations with CRM/ERP/billing systems; collaborate with stakeholders and evolve a Snowflake/dbt cloud-native data platform.

Design, build, and maintain scalable data systems and ETLs on GCP; connect production data to business systems; generate analytics and ML-driven insights for GTM teams; work cross-functionally and introduce modern tools (Airflow, DBT, Presto, Hightouch).

Design and implement BI solutions: build data models, automations, ETL/ELT workflows, dashboards, and ad-hoc analyses. Monitor and analyze RF/video performance using Dataminer/Qligent or similar tools. Collaborate with cross-functional teams, document requirements, and deliver actionable insights to optimize hybrid terrestrial and satellite video delivery.

Design, build, and maintain scalable batch and streaming data pipelines, improve data modeling and governance, contribute to enterprise data architecture, and collaborate with cross-functional teams to ensure reliable, high-quality data for analytics and operational use.

Lead design and delivery of scalable, secure cloud data pipelines and products. Translate requirements into architecture, apply advanced data modeling (Data Vault 2.0/dimensional), embed data quality, observability, security, and DataOps/CI-CD practices, optimize performance and cost, mentor engineers, and enable AI/ML-ready datasets within an agile DevSecOps model.

Design, build, and operate scalable cloud data pipelines and platforms (Azure preferred). Implement DevSecOps, CI/CD, automated testing, monitoring, performance tuning, and production readiness. Mentor engineers, drive operational excellence, and translate requirements into robust technical designs. Apply healthcare domain knowledge and collaborate in agile teams to deliver secure, reliable data products.

The job involves building responsive web dashboards, advanced data visualizations, and analytics tools for unmanned aircraft systems, requiring a deep understanding of UI/UX design and data presentation.

Work directly with customers to design, build, and maintain data integrations and pipelines, troubleshoot ingestion/transformation/delivery issues, optimize large-scale data processing, collaborate with data scientists, and guide technical onboarding and long-term success.

Build and maintain production data pipelines and foundations for People Analytics and AI-driven tools. Integrate HR systems (Workday, Greenhouse), design data models, ensure governance for sensitive employee data, support data science and reporting, and deliver dashboards and Streamlit apps. Optimize queries, enable LLM consumption with quality and latency controls, and collaborate cross-functionally to transition AI prototypes to production.

The Senior Data Engineer will design scalable data processing frameworks using Java and Apache Spark, manage data pipelines, and mentor junior engineers.

Design, build, and maintain an internal data platform enabling secure, governed access for engineering and analytics. Partner with architects, implement data pipelines and automations, enforce security and compliance, support platform services, recommend architecture improvements, mentor teams, and drive adoption of scalable, self-service data capabilities.

Own end-to-end client data migrations: reverse-engineer legacy ETL, design and build Airflow DAGs and Spark jobs, validate and reconcile data at scale, document architecture and decisions, and coordinate cross-functional teams through go-live and hypercare.

Lead a team of data engineers to design, build, and maintain scalable data pipelines, a Data Vault, data warehouses and marts. Own backlog, sprint planning, mentoring, stakeholder collaboration, data validation/monitoring, and platform improvements to deliver key metrics and data infrastructure across the business.

Operate and ensure reliability of ELT/data and integration pipelines (Airflow, Azure Integration Services). Monitor SLAs, respond to incidents, perform root cause analysis, manage Snowflake RBAC, support deployments (dbt, GitHub Actions), optimize performance, and collaborate across engineering, security, and analytics teams to maintain secure, on-time data delivery.

Design and build BI ingestion pipelines and star-schema data models, develop calculations (DAX), create dashboards and paginated reports, manage governance/access (RLS, workspaces), and collaborate with cross-functional teams to deliver business-focused visualizations.

Design, deploy, and maintain scalable data infrastructure and orchestration for analytics and ML; write optimized SQL over large warehouses; partner with engineering and product to structure source systems; maintain CDC pipelines; scale reporting and expose analytical datasets enterprise-wide while ensuring data management, security, and compliance.

Design and own end-to-end data platform architecture, build ingestion and transformation pipelines, model multi-tenant datasets, optimize Postgres and ClickHouse performance/cost, implement orchestration and observability, define data quality and reconciliation standards, and mentor data/product engineers.

Design, implement, and manage scalable multi-cloud data platforms and ELT pipelines (AWS/Azure). Build and optimize Snowflake data models, dbt transformations, and Airflow orchestration. Define data engineering standards, enforce governance and quality, collaborate cross-functionally, and mentor global/offshore teams.

Build and maintain automated ETL/ELT data pipelines, improve data quality and monitoring, optimize Postgres and BigQuery schemas and queries, develop internal tooling, support data governance (HIPAA), participate in on-call rotation, and collaborate across engineering teams to scale data systems.

The Data Engineer will design and maintain data pipelines, enhance the data warehouse, support machine learning applications, and collaborate with various teams to leverage data effectively.

The Senior Data Engineer will build and maintain ETL/ELT pipelines, optimize SQL queries, and collaborate on machine learning workflows, driving data engineering best practices.

Design, build, and maintain scalable data lakehouse platforms and ELT pipelines. Improve engineering practices, develop automation/tooling, monitor performance, reduce costs, and support platform modernization across Azure and cloud data technologies.