Top Data Engineer Jobs in Houston, TX

Designs, develops, and supports analytics data solutions for clients, including Snowflake and dbt ingestion and transformation pipelines, data marts, validation, monitoring, governance, and documentation. Manages multiple consulting projects, budgets, timelines, quality assurance, troubleshooting, client communication, and implementation planning. Requires strong data engineering experience, regulated-industry knowledge, stakeholder communication, and willingness to travel.

Administer and enhance Edmunds’ Databricks data platform and AWS infrastructure. Build and maintain ETL pipelines, infrastructure-as-code tooling using Terraform or CDK, and operational dashboards, alerts, and reports. Collaborate with business, engineering, analytics, security, and infrastructure teams to support data platform users and AI solutions. Evaluate new technologies, troubleshoot platform issues, and improve operational, cost, and security visibility.

Define and govern enterprise-scale data architecture across batch, streaming, warehouse, lakehouse, transactional, and AI use cases. Establish standards for data quality, lineage, access, cataloging, governance, observability, and SLAs. Architect AI-enabled workflows, resolve complex architecture issues, influence roadmaps, and mentor engineers through hands-on technical leadership. The role requires 15+ years of software, data engineering, or architecture experience and expertise in large-scale data platforms and modeling.

Design, implement, and manage advanced data ecosystems and scalable ETL/ELT pipelines. Analyze complex problems, deliver data warehousing and governance solutions, mentor junior staff, and build client relationships while maintaining high standards and business-context awareness.

Lead design and implementation of enterprise data architecture and cloud-based data solutions. Manage large data engineering projects, develop data models and pipelines, ensure governance and security compliance, advise clients strategically, and build high-performing inclusive teams.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Design, build, and operate Azure-based data pipelines and integrations. Consolidate data from multiple sources into centralized SQL systems, perform transformations and field mapping, and maintain data warehouse capabilities. Troubleshoot quality, integrity, latency, security, and reliability issues while applying governance, monitoring, and SLA practices. Collaborate with engineers, analysts, and stakeholders in Agile pods to deliver reusable, analytics-ready data assets.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Configure and maintain Adobe Experience Platform and Real-Time CDP data pipelines, XDM schemas, datasets, identity resolution, Profile enablement, segmentation readiness, and destination activation. Validate data quality, troubleshoot ingestion and identity issues, manage sandboxes, and implement privacy, consent, governance, and access controls. Partner with architects, data engineers, consultants, analysts, data scientists, and marketing teams to support reporting, personalization, and machine learning readiness.

Build scalable, secure data pipelines, models, platforms, and governance systems that enable AI applications to access trusted enterprise data. Partner with analytics, marketing, and product teams to translate requirements into technical solutions, independently deliver projects through production, and support sensitive-data security and access controls. Preferred experience includes LLM architectures, cloud data platforms, infrastructure as code, regulated environments, and technical leadership.

Design and scale lakehouse architecture, including Bronze, Silver, and Gold data layers. Build reliable streaming and batch pipelines with Kafka, Spark, and Airflow; manage Iceberg, Delta, and Hudi table formats; optimize Trino, Starburst, and Databricks queries; and improve platform reliability, data quality, and performance. Collaborate with data scientists, analysts, and product teams to deliver scalable data platform solutions.

Design and scale lakehouse architecture, streaming and batch pipelines, and reliable data platforms using Kafka, Spark, Airflow, Iceberg, Databricks, and related technologies. Build Medallion-layer data systems, manage open table formats, optimize distributed queries, monitor platform reliability, resolve data quality issues, and collaborate with analysts, data scientists, and product teams.

Build and maintain scalable ETL/ELT pipelines and data foundations using Databricks, dbt, and AWS. Transform raw structured and unstructured data into reliable datasets for product analytics and data science, including telemetry, streaming data, and feature engineering. Develop dashboards in Tableau and Databricks, optimize workflows, and collaborate with Product, Engineering, analytics, and data science stakeholders to support product health, adoption, and performance insights.

Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.

Design and manage financial systems for accurate cashback calculations, build and maintain reconciliation processes, ensure data integrity for yield-bearing instruments, collaborate with compliance, and partner with cross-functional teams to improve financial system efficiency.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Designs, develops, and supports SAP HANA reporting solutions and enterprise data products. Responsibilities include building data pipelines, calculation views, BI visualizations, embedded analytics, validation processes, metadata documentation, demos, and user training. The role partners with stakeholders, analysts, data scientists, and process teams to translate business requirements into deployable data solutions and improve the organization’s data platform.

Supports data engineering, ETL, database, platform, and integration workstreams. Responsibilities include data extraction, pipeline testing, environment setup, database support, source-system profiling, data cleansing, Ed-Fi ODS loading, validation, Oracle and SQL Server migration support, SharePoint configuration, year-end rollover tasks, and technical documentation under senior staff guidance.

Build and configure a government Databricks workspace, develop ingestion pipelines from enterprise systems, and prepare data for reporting. Implement Unity Catalog governance, metadata, auditing, and lineage; configure MLflow workflows; assess security controls for sensitive data; and create architecture documentation, data dictionaries, and operating procedures. The role also requires integrating legacy systems, optimizing Delta Lake pipelines, and supporting long-term platform sustainment.

Performs data engineering operations including SQL scripting, ETL and data validation, query optimization, data analysis, dashboard maintenance, task-result validation, and troubleshooting with engineering and DBA teams. Ensures data integrity and compliance, manages ticket-based assignments, and supports data production and implementations. The role may require after-hours or weekend support and includes preferred experience with network security platforms, certificate management, and automation scripting.

Designs and maintains ELT pipelines, warehouse integrations, data models, and data quality processes. Collaborates with data scientists, analysts, engineers, and stakeholders to deliver scalable analytical solutions. Responsibilities include data integration, governance, security, performance optimization, exploratory analysis, visualization, and cloud-based API ingestion. Requires strong SQL, DBT, Snowflake, Azure Data Factory, cloud, and scripting experience, plus leadership and communication skills.

Design, build, and maintain scalable cloud data lake infrastructure supporting analytics, reporting, and AI/ML. Develop batch and real-time ETL/ELT pipelines, data quality frameworks, governance policies, metadata and lineage systems, security controls, monitoring, disaster recovery, and performance optimization. Collaborate with IT, analytics, operations, and AI teams to ensure data integrity, compliance, accessibility, and effective use of enterprise datasets.

Build and operate data-intensive web products and APIs, extend high-throughput ETL pipelines and scrapers, ensure reliability/observability, design self-scaling services, participate in code review, and collaborate across product, data, and infrastructure teams to meet production SLAs.

Build and maintain production data pipelines, Airflow DAGs, Snowflake infrastructure, and Data Vault 2.0 models. Ensure data quality, observability, security, governance, reliability, and cost efficiency through automated testing and CI/CD. Lead technical projects end-to-end, collaborate with stakeholders, and support SOX-relevant reporting while developing expertise in commercial insurance data and processes.

The Forward Deployed Data Engineer will manage AI-automated data platform migration projects, ensuring timely delivery and communication with clients while utilizing proprietary tools.