Top Senior Data Engineer Jobs in Houston, TX

Designs, administers, and optimizes data systems supporting FSA IAM applications. Develops migration plans from legacy AIMS and PAS systems, creates data models, mappings, layouts, dictionaries, and integration processes, and supports analytics and fraud detection. Manages database configuration, performance tuning, monitoring, backups, capacity, secure data handling, encryption, network data flows, token management, and documentation while collaborating with development, security, and operations teams.

Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.

Lead architecture and buildout of a new graph-backed enterprise data platform: design ingestion, graph and relational storage, entity resolution pipelines, temporal models, ETL/ELT pipelines, governance, APIs, and production connectors. Ship scalable graph data models, traversal queries, and platform roadmap while enabling observability, security, and containerized deployments.

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

Manage, design, and optimize data activities for federal IAM systems. Develop data models, file layouts, source-to-target mappings, data dictionaries, integrations, ETL processes, and analytics support for identity analysis and fraud detection. Administer and tune databases, including configuration, backups, monitoring, capacity planning, and performance optimization. Support secure handling of identity and PII data, network-related data flows, documentation, token management processes, and collaboration across development, security, and operations teams.

Architect and maintain NetBrain’s first cloud data warehouse, ELT pipelines, transformation layer, semantic models, and BI foundation. Own data quality, governance, lineage, access controls, and curated models supporting product usage, customer adoption, account health, and go-to-market reporting. Partner with stakeholders to establish reliable metrics and a standardized source of truth, while supporting AI-assisted analytics and natural-language reporting use cases.

Design, build, and own scalable data pipelines and warehousing architecture from ingestion through analytics and incentive payouts. Lead data platform architecture, dbt modeling, data quality, lineage, observability, performance, and cost management. Partner with engineers and analysts on telematics accuracy and driver incentive reporting. Use AI coding tools daily to develop and review pipelines, SQL, and data models.

Designs, builds, and operates scalable enterprise data platforms supporting ingestion, processing, storage, governance, analytics, and AI/ML. Responsibilities include developing batch and real-time pipelines, lakehouse and warehouse architectures, orchestration, infrastructure automation, CI/CD, monitoring, security, cost optimization, and observability. The role partners with data, ML, DevOps, security, and application teams, troubleshoots complex platform issues, establishes reusable engineering standards, contributes to architecture strategy, and mentors engineers.

Own end-to-end data platform architecture across ingestion, transformation, modeling, and serving. Improve warehouse efficiency, access control, reliability, observability, orchestration, CI/CD, and developer experience. Lead cross-functional technical initiatives, build monitoring and alerting, mentor engineers, guide architectural decisions, and develop AI-powered data tooling. The role requires strong SQL and Python skills, production experience with Airflow, BigQuery, and containerized infrastructure, plus architectural ownership and stakeholder communication.

The role involves architecting and improving data systems, defining governance standards, optimizing performance, and mentoring engineers in data engineering.

Leads the design, development, administration, and optimization of enterprise data pipelines and Microsoft Fabric data platforms. Responsibilities include ETL/ELT architecture, medallion layers, data quality, CI/CD, infrastructure as code, security, hybrid connectivity, disaster recovery, performance optimization, and troubleshooting. The role also mentors engineers, establishes technical standards, supports architecture reviews, and provides senior-level guidance for secure, scalable, reliable data platform implementations.

Lead design and development of web UI and REST middleware within an Agile team. Define requirements and acceptance criteria, implement Java/Spring and Angular solutions, build CI/CD pipelines, work with Product Owner and testers, and produce/update design documentation.

Design and maintain scalable ETL/ELT pipelines, data integrations, APIs, databases, warehouses, and workflow orchestration. Improve data quality, security, governance, reporting accessibility, and infrastructure reliability across a multi-location organization. Collaborate with analysts, technology teams, and business leaders, troubleshoot complex data issues, support CI/CD deployments, and provide technical leadership and mentorship while shaping long-term data strategy.

Design, build, maintain, and optimize Spark and Scala ETL/ELT pipelines on AWS for terabyte- and petabyte-scale datasets. Work across S3, Snowflake, Kafka, and monitoring systems, resolve production data-quality and performance issues, write automated tests, participate in architecture and code reviews, and support on-call operations. Use generative AI to improve pipeline development, monitoring, and engineering productivity.

Manages and evolves enterprise data lakes and warehouses, designing scalable AWS-based batch, CDC, and near-real-time ETL/ELT pipelines. Builds data quality, governance, lineage, security, monitoring, and recovery controls; optimizes Spark, Glue, Athena, Redshift, and S3 workloads. Develops reusable Python, SQL, and PySpark frameworks, supports schema evolution and analytical data modeling, and collaborates with business and technical stakeholders to deliver reliable data solutions.

Lead architecture and hands-on engineering to design, scale, and govern a cloud-native lakehouse using Databricks and Microsoft Fabric. Build batch/streaming pipelines, ensure HIPAA-compliant PHI handling, produce analytics-ready datasets, mentor engineers, and drive platform strategy, governance, and reliability.

Build and operate production-grade data pipelines and models connecting marketing, event, operational, and SaaS data into Databricks. Own data quality, testing, monitoring, lineage, orchestration, attribution, identity resolution, and governed semantic-layer contributions. Partner cross-functionally on privacy-aware data flows, event taxonomies, and reliable Growth data products while improving engineering standards and maintainability.

Develop and maintain large-scale, cloud-native data services and distributed pipelines for multi-tenant healthcare systems. Responsibilities include data modeling, database component development, SQL programming, performance tuning, testing, deployment, code reviews, proof-of-concepts, and full software development lifecycle ownership. Collaborate with global engineering teams, evaluate technologies, apply security and operational requirements, and use AI tools to accelerate development.

Leads the design, automation, optimization, and maintenance of scalable data pipelines using Airflow, dbt, Python, SQL, and Google Cloud technologies. Manages dbt models, develops reusable architecture patterns, monitors pipeline performance, supports CI/CD and testing, and ensures data security and governance. The role also provides technical leadership, mentors engineers, collaborates cross-functionally, documents implementations, and drives continuous improvement across data engineering practices.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.

Build and maintain low-latency, highly available distributed data systems and services to deliver high-quality data for product, analytics, and ML. Partner with data scientists and product teams to design scalable, observable, multi-tenant data products using batch and real-time processing frameworks. Ensure 24x7 reliability, monitoring, and operational excellence while owning end-to-end delivery.

Design, build, and own large-scale batch and streaming data pipelines and core Ads data products. Collaborate with analytics, data science, and engineering teams to model, transform, govern, and deliver high-quality ad datasets for analysis, ML, and reporting while ensuring privacy compliance.

Lead database engineering for a federal species-data integration program in a hybrid AWS cloud environment. Responsibilities include harmonizing schemas, documenting source-to-target mappings and lineage, enforcing metadata and data-quality standards, implementing encryption and NIST-aligned security controls, building authoritative source registries, optimizing performance, and leading production migration, validation, monitoring, and operational documentation. The role requires Databricks or equivalent lakehouse expertise, ETL programming, federal governance knowledge, and database migration leadership.

Designs secure Azure data pipelines and analytics foundations using Databricks and ADLS Gen2. Responsibilities include modernizing Oracle workloads, developing medallion data models, implementing data quality and monitoring practices, integrating curated datasets with Power BI, and establishing secure Azure Government identity, network, storage, and access patterns. The role also requires documentation, operational support, stakeholder collaboration, and performance optimization.

Build and maintain centralized pricing data infrastructure, scalable workflows, and data pipelines; integrate AI capabilities; deliver pricing tools, reporting, and governance to support data-driven pricing and budgeting across the firm.