Top Senior Data Engineer Jobs in San Antonio, TX

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

Designs and operates an AWS-native lakehouse supporting analytics, reporting, visualization, and AI/ML. Builds batch and streaming ingestion pipelines using Python and PySpark, Apache Iceberg data structures, governance and metadata services, quality controls, security, observability, and CI/CD automation. Optimizes performance, scalability, reliability, and cost while collaborating with cross-functional technical teams and documenting architecture, operations, and secure configurations.

Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Lead design and scaling of the data platform and analytics pipelines. Build and maintain ETL/ELT workflows, integrations, serverless data services, and reliable data models. Mentor teammates, improve automation, observability, and data governance to support analytics and operational insights.

Own and evolve the data infrastructure powering identity and fraud products. Build and operate scalable ETL/ELT pipelines, ensure data quality and observability, optimize storage and access, support product squads, respond to production incidents, mentor engineers, and drive data platform innovation.

Lead the Data Platform Engineering team owning ETL/reverse-ETL pipelines, replication, and production datastores. Define architecture, roadmap, standards (IaC, observability, schema contracts), mentor engineers, drive incident response and durable fixes, and partner on cross-team technical decisions and operational reliability for data correctness, completeness, and timeliness.

Designs and maintains healthcare data pipelines, ETL workflows, databases, data models, and analytical frameworks. Analyzes claims and payer data to identify trends and insights, while ensuring data quality and integrity. Creates reports, dashboards, and visualizations for nontechnical stakeholders and collaborates with healthcare policy experts, analysts, and other stakeholders to translate requirements into data solutions. The role also improves data infrastructure and analytics capabilities.

Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.

Designs, implements, and supports enterprise data warehouses, data marts, operational data stores, ETL frameworks, and data integration solutions. Responsibilities include source analysis, data profiling, pipeline development, data mapping, transformation design, architecture documentation, testing, quality validation, deployment coordination, performance optimization, and regulatory compliance. The role collaborates with architects, business users, operations teams, and cross-functional partners while using Talend and cloud, big data, database, and scheduling technologies.

Architect, build, and operate low-latency market data systems, including feed handlers, normalization, distribution, and exchange connectivity. Design high-throughput infrastructure for real-time trading data, improve reliability and performance, participate in observability, on-call, and incident response, and deliver well-tested features end to end. Partner with engineering, product, and cross-functional stakeholders while leading a lean, high-impact team.

Build and maintain governed Silver/Gold data models and semantic assets on Databricks. Translate stakeholder KPIs into testable, reusable transformations, apply enterprise modeling standards, enable domain self-service, ensure data sensitivity and governance, and review domain-contributed models for production readiness.

Build Sailor Health’s foundational data platform from scratch. Responsibilities include developing Snowflake and dbt pipelines integrating EHR, CRM, and communications data; creating data-powered web applications; automating clinical and billing workflows with Python; analyzing therapy transcripts and patient data using AI and machine learning; tracking clinical outcomes; and designing scalable data architectures in collaboration with clinicians, engineers, founders, and other teams.

Design, build, and maintain scalable production data pipelines and cloud-based solutions in Microsoft Azure. Develop Python, SQL, Spark, Spark SQL, and PySpark workflows for data ingestion, transformation, integration, analytics, reporting, and machine learning. Monitor, troubleshoot, validate, and optimize data pipelines and large-scale processing workloads while collaborating with technical teams and stakeholders. Document architectures and follow software engineering best practices for testing, version control, and deployment.

Designs, administers, and optimizes data systems supporting FSA IAM applications. Develops migration plans from legacy AIMS and PAS systems, creates data models, mappings, layouts, dictionaries, and integration processes, and supports analytics and fraud detection. Manages database configuration, performance tuning, monitoring, backups, capacity, secure data handling, encryption, network data flows, token management, and documentation while collaborating with development, security, and operations teams.

Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.

Lead architecture and buildout of a new graph-backed enterprise data platform: design ingestion, graph and relational storage, entity resolution pipelines, temporal models, ETL/ELT pipelines, governance, APIs, and production connectors. Ship scalable graph data models, traversal queries, and platform roadmap while enabling observability, security, and containerized deployments.

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

Manage, design, and optimize data activities for federal IAM systems. Develop data models, file layouts, source-to-target mappings, data dictionaries, integrations, ETL processes, and analytics support for identity analysis and fraud detection. Administer and tune databases, including configuration, backups, monitoring, capacity planning, and performance optimization. Support secure handling of identity and PII data, network-related data flows, documentation, token management processes, and collaboration across development, security, and operations teams.

Lead architecture and reliability of the data platform, build and harden ingestion (batch and CDC), own BigQuery+dbt transformations, establish testing/observability/governance, mentor engineers, develop Python tooling and APIs, run POCs for lakehouse/open table formats, and define AI-assisted development practices.

The role involves architecting and improving data systems, defining governance standards, optimizing performance, and mentoring engineers in data engineering.

Lead design and development of web UI and REST middleware within an Agile team. Define requirements and acceptance criteria, implement Java/Spring and Angular solutions, build CI/CD pipelines, work with Product Owner and testers, and produce/update design documentation.

Design, build, and optimize scalable ETL/ELT data pipelines using Databricks and cloud platforms. Implement data quality checks, monitor and troubleshoot jobs, audit pipelines for compliance, and collaborate with analysts and business stakeholders to define data models and support reporting.

Design, build, maintain, and optimize Spark and Scala ETL/ELT pipelines on AWS for terabyte- and petabyte-scale datasets. Work across S3, Snowflake, Kafka, and monitoring systems, resolve production data-quality and performance issues, write automated tests, participate in architecture and code reviews, and support on-call operations. Use generative AI to improve pipeline development, monitoring, and engineering productivity.