Top Senior Data Engineer Jobs in Baton Rouge, LA

In this role, you will design data architecture, lead integration strategies, mentor engineers, and drive AI infrastructure for cross-division data systems.

The Sr. Data Engineer - Databricks designs and maintains scalable data solutions using Apache Spark and Databricks, ensuring data quality and performance for analytics and reporting.

Design, build, and maintain end-to-end batch and streaming data pipelines on GCP. Migrate legacy warehouses to BigQuery/Bigtable/ClickHouse, orchestrate workflows in Airflow, ensure data quality and observability, and partner with ML engineers on feature pipelines, drift monitoring, and retraining.

Design, build, and automate scalable batch and streaming data pipelines, implement data models and ETL, automate deployments, support ML/experimentation, maintain server architecture, and partner with stakeholders to deliver analytics and data-driven tools.

Own and architect the semantic layer and metrics/metadata for the data platform (Databricks/GCP). Build AI-ready models, enforce modeling and documentation standards, implement observability/testing for pipelines, enable self-serve analytics, and collaborate across product, clinical, and business teams to translate questions into reliable data solutions.

Design, build, and maintain scalable, secure data architectures, models, and ETL pipelines. Integrate diverse data sources, optimize performance and data quality, implement governance, monitor production SLAs, and collaborate with data scientists, analysts, and product teams. Provide technical leadership, documentation, and training to improve engineering practices across the organization.

Lead a team of 5-6 data engineers to design and implement scalable data pipelines (Airflow), manage Snowflake data architecture, build real-time streaming solutions with Kafka/Spark Streaming, develop and integrate APIs, enforce code quality, and drive technical decisions and best practices.

Design, build, and maintain scalable ETL/ELT pipelines and product-level data architectures. Improve pipeline performance and data freshness, lead code/design reviews, mentor engineers, and collaborate with Data Science, Product, and Engineering to make data reliable and accessible.

The Senior Data Engineer will design and build data pipelines and infrastructure to support data science and business intelligence solutions, utilizing AWS services and streaming technologies.

The Senior Data Engineer will design and implement lakehouse architectures, optimize ClickHouse deployments, develop ETL/ELT pipelines, and create data models to support analytical and operational functions.

Own and evolve end-to-end data pipeline architecture across ingestion, transformation, modeling, and serving. Lead platform improvements (cost, compute efficiency, access control), CI/CD, monitoring, and incident response. Drive cross-team technical initiatives, mentor engineers, and integrate AI tooling to improve workflows while remaining hands-on building and debugging production pipelines.

Own end-to-end data pipelines (ingest, dbt transformations, BigQuery warehousing) and consolidate the analytics stack into a single source of truth. Build and maintain dbt models with tests and documentation, establish data quality and observability, own product analytics and instrumentation, partner with GTM and marketing on reporting, and prepare for high-volume/streaming ingestion.

Lead design, build, test, and maintain scalable cloud data platforms and pipelines (ETL/ELT, batch and streaming). Ensure data quality, governance, security, CI/CD deployment, performance tuning, migration/archival, and mentor data engineering teams to support analytics and AI/ML use cases for a federal modernization program.

Design, build, and maintain production-scale data systems and web-scale datasets (Spark/Flink) to support personalization ML. Drive dataset/schema design, collaborate with algorithm teams, and improve distributed big-data processing for member experience.

Technical leader for Data Engineering responsible for designing, operating, and optimizing Snowflake-based data platforms, self-hosted orchestration (Prefect), dbt practices, AWS infrastructure, and data pipelines. Drive architecture, mentor engineers, partner cross-functionally, ensure observability and production-grade practices, and enable model-ready datasets and AI/LLM workflows.

Design, build, operate, and optimize large-scale production data pipelines and foundational Healthcare Map data products using Python, SQL, Airflow, Spark, and AWS. Ensure data quality, observability, and performance; debug complex workflows; contribute to architecture, CI/CD, testing, documentation, and cross-functional delivery to enable analytics and AI/ML use cases.

Design, build, and scale reliable batch and real-time data pipelines and warehouses. Partner with engineering, data science, and business teams to define data models, improve observability, optimize storage and querying, and evangelize data engineering best practices across the company.

Design, build, and maintain scalable Databricks-based data pipelines and ELT workflows; develop and document dbt models; define data modeling methodology; ensure data quality, reliability, and scalability; collaborate with clients and cross-functional teams; provide technical guidance and deliver improvements to clients' data infrastructure and analytics capabilities.

Design, build, and optimize scalable batch and streaming data pipelines. Model and process structured and unstructured data, ensure production reliability and observability, apply ML techniques for insight extraction, and drive data strategy while adopting modern tooling and IaC practices.

Build and own data platform infrastructure and scalable pipelines (ingestion, orchestration, transformation, delivery). Define governance, observability, and AI-first architecture. Optimize performance, ensure data quality, mentor engineers, and integrate AI-assisted tooling.

Own and evolve the data platform: architect, build, and maintain data models, pipelines, and access layers. Ensure data quality, governance, and reliability; monitor and optimize infrastructure; provide technical leadership, code reviews, and collaborate with cross-functional teams to deliver scalable data solutions for operations and analytics.

Lead technical design and hands-on development of Pantheon’s data platform, extending ingestion, curation, retention services and ML/LLM infrastructure. Mentor engineers, drive architecture and engineering standards, operate in a DevOps model, partner cross-functionally, and participate in on-call support to ensure reliable, compliant data access and analytics.

The Senior Data Engineer will design and build scalable data platforms, handle automation for data operations, and ensure reliability and performance of data pipelines while collaborating with various teams.

Lead a team to design, build, and maintain cloud data engineering solutions using Microsoft Fabric and Azure Synapse. Responsibilities include architecture, data pipelines, lakehouse and warehousing implementation, governance, performance optimization, mentoring engineers, cross-functional collaboration, support/on-call, documentation, and ensuring reliability and compliance.

Lead the vision and execution for scalable data governance and quality across Airbnb. Architect future-proof data ecosystems, define best practices and tooling, drive cross-functional policy implementation (privacy, legal, infosec), mentor senior engineers, and influence executive strategy to embed stewardship into the data product lifecycle.