Top Senior Data Engineer Jobs in Washington, DC

Design, develop, and optimize enterprise-scale data platforms, pipelines, data lakes, warehouses, and analytical datasets on Azure and Snowflake. Build ETL/ELT processes using ADF, Databricks, PySpark, SQL, Python, and Snowflake. Manage data models, governance, security, quality, CI/CD, cloud migrations, and performance optimization. Collaborate with stakeholders, troubleshoot production issues, document solutions, and support Agile delivery.

Designs, builds, and manages cloud-based data systems, including pipelines, data lakes, warehouses, lakehouses, databases, and ETL processes. Develops optimized Python and SQL queries, improves workflow performance, and supports data movement between on-premises and cloud environments. Collaborates with leadership, analysts, research teams, and other departments to define requirements and reporting needs. Applies data governance, access controls, security, compliance, troubleshooting, and system support practices.

Designs and scales cloud-native data platforms and ingestion pipelines using AWS, Databricks, and Spark. Builds APIs, file-upload mechanisms, ETL/ELT workflows, data transformations, and Lakehouse architecture supporting analytics, machine learning, and operational use cases. Provides operational support for legacy C# .NET ingestion processes, troubleshoots pipelines, and promotes data governance, security, reliability, and documentation in a multi-tenant SaaS environment.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Builds and maintains scalable data pipelines, ETL infrastructure, data warehouses, and analytics tools. The role assembles complex datasets, automates processes, optimizes data delivery architecture, and supports cross-functional data initiatives. Collaborates with executive, product, data, and design stakeholders to resolve technical issues and improve analytics systems. Requires proficiency in SAS, Python, Java, MATLAB, SQL, NoSQL, Hadoop, MapReduce, Hive, Presto, UNIX, and Linux, with JavaScript, R, and basic machine learning preferred.

Design, build, and optimize end-to-end data pipelines and dataflows, integrate with AWS, maintain schemas/data dictionaries, provide Tier 3 support, collaborate with stakeholders and product teams, document architectures, and support off-hours deployments. Ensure data governance, scalability, and production readiness while working primarily on-site in a cleared defense environment.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

Designs and operates an AWS-native lakehouse supporting analytics, reporting, visualization, and AI/ML. Builds batch and streaming ingestion pipelines using Python and PySpark, Apache Iceberg data structures, governance and metadata services, quality controls, security, observability, and CI/CD automation. Optimizes performance, scalability, reliability, and cost while collaborating with cross-functional technical teams and documenting architecture, operations, and secure configurations.

The Senior IT Data Engineer will design and implement enterprise data architectures, develop scalable ETL/ELT pipelines, and support data-driven initiatives for the Federal Reserve Board.

Design, build, and maintain scalable ETL/data pipelines and an authoritative Lakehouse using Databricks and cloud platforms. Collaborate on data platform strategy, implement CI/CD, model data, refresh dashboards, apply advanced analytics (LLMs/AI) to unstructured data, and support post-award reporting to improve grant program outcomes.

Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.

Designs, builds, and maintains secure cloud data pipelines and centralized repositories; publishes curated datasets; develops WPS AI agents; produces dashboards and visualizations for senior military leadership; supports NATO and annual statutory reporting and prepares technical briefings and deliverables.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

Lead design and scaling of the data platform and analytics pipelines. Build and maintain ETL/ELT workflows, integrations, serverless data services, and reliable data models. Mentor teammates, improve automation, observability, and data governance to support analytics and operational insights.

Own and evolve the data infrastructure powering identity and fraud products. Build and operate scalable ETL/ELT pipelines, ensure data quality and observability, optimize storage and access, support product squads, respond to production incidents, mentor engineers, and drive data platform innovation.

Lead the Data Platform Engineering team owning ETL/reverse-ETL pipelines, replication, and production datastores. Define architecture, roadmap, standards (IaC, observability, schema contracts), mentor engineers, drive incident response and durable fixes, and partner on cross-team technical decisions and operational reliability for data correctness, completeness, and timeliness.

Designs and maintains healthcare data pipelines, ETL workflows, databases, data models, and analytical frameworks. Analyzes claims and payer data to identify trends and insights, while ensuring data quality and integrity. Creates reports, dashboards, and visualizations for nontechnical stakeholders and collaborates with healthcare policy experts, analysts, and other stakeholders to translate requirements into data solutions. The role also improves data infrastructure and analytics capabilities.

Analyzes and manages quantitative data, develops Power Automate workflows integrated with Tableau and SharePoint, and supports reporting, data quality, data modeling, and data management processes. The role includes reviewing errors, merging data sources, preparing summaries and presentation graphics, documenting corrections, and ensuring data integrity. It also requires extensive experience with web services and software testing tools, Agile testing life cycles, and secure federal client environments.

Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.

Designs, implements, and supports enterprise data warehouses, data marts, operational data stores, ETL frameworks, and data integration solutions. Responsibilities include source analysis, data profiling, pipeline development, data mapping, transformation design, architecture documentation, testing, quality validation, deployment coordination, performance optimization, and regulatory compliance. The role collaborates with architects, business users, operations teams, and cross-functional partners while using Talend and cloud, big data, database, and scheduling technologies.

Architect, build, and operate low-latency market data systems, including feed handlers, normalization, distribution, and exchange connectivity. Design high-throughput infrastructure for real-time trading data, improve reliability and performance, participate in observability, on-call, and incident response, and deliver well-tested features end to end. Partner with engineering, product, and cross-functional stakeholders while leading a lean, high-impact team.

Build and maintain governed Silver/Gold data models and semantic assets on Databricks. Translate stakeholder KPIs into testable, reusable transformations, apply enterprise modeling standards, enable domain self-service, ensure data sensitivity and governance, and review domain-contributed models for production readiness.

Build Sailor Health’s foundational data platform from scratch. Responsibilities include developing Snowflake and dbt pipelines integrating EHR, CRM, and communications data; creating data-powered web applications; automating clinical and billing workflows with Python; analyzing therapy transcripts and patient data using AI and machine learning; tracking clinical outcomes; and designing scalable data architectures in collaboration with clinicians, engineers, founders, and other teams.