Top Senior Data Engineer Jobs in Washington, DC

Designs, administers, and optimizes data systems supporting FSA IAM applications. Develops migration plans from legacy AIMS and PAS systems, creates data models, mappings, layouts, dictionaries, and integration processes, and supports analytics and fraud detection. Manages database configuration, performance tuning, monitoring, backups, capacity, secure data handling, encryption, network data flows, token management, and documentation while collaborating with development, security, and operations teams.

Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.

Lead architecture and buildout of a new graph-backed enterprise data platform: design ingestion, graph and relational storage, entity resolution pipelines, temporal models, ETL/ELT pipelines, governance, APIs, and production connectors. Ship scalable graph data models, traversal queries, and platform roadmap while enabling observability, security, and containerized deployments.

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

Manage, design, and optimize data activities for federal IAM systems. Develop data models, file layouts, source-to-target mappings, data dictionaries, integrations, ETL processes, and analytics support for identity analysis and fraud detection. Administer and tune databases, including configuration, backups, monitoring, capacity planning, and performance optimization. Support secure handling of identity and PII data, network-related data flows, documentation, token management processes, and collaboration across development, security, and operations teams.

Designs, builds, and operates scalable enterprise data platforms supporting ingestion, processing, storage, governance, analytics, and AI/ML. Responsibilities include developing batch and real-time pipelines, lakehouse and warehouse architectures, orchestration, infrastructure automation, CI/CD, monitoring, security, cost optimization, and observability. The role partners with data, ML, DevOps, security, and application teams, troubleshoots complex platform issues, establishes reusable engineering standards, contributes to architecture strategy, and mentors engineers.

Build and operate core data infrastructure for edge and hybrid environments, including ingestion, OT/IoT integrations, real-time streaming, data contracts, schemas, validation, lineage, observability, telemetry, and scalable query access. The role requires production ownership, reliability practices, customer integration, and collaboration across engineering and customer-facing teams. Candidates should have 6+ years of experience with production data, streaming, or integration systems and proficiency in Python and/or Go.

Lead architecture and reliability of the data platform, build and harden ingestion (batch and CDC), own BigQuery+dbt transformations, establish testing/observability/governance, mentor engineers, develop Python tooling and APIs, run POCs for lakehouse/open table formats, and define AI-assisted development practices.

Own end-to-end data platform architecture across ingestion, transformation, modeling, and serving. Improve warehouse efficiency, access control, reliability, observability, orchestration, CI/CD, and developer experience. Lead cross-functional technical initiatives, build monitoring and alerting, mentor engineers, guide architectural decisions, and develop AI-powered data tooling. The role requires strong SQL and Python skills, production experience with Airflow, BigQuery, and containerized infrastructure, plus architectural ownership and stakeholder communication.

The role involves architecting and improving data systems, defining governance standards, optimizing performance, and mentoring engineers in data engineering.

Design, build, and maintain scalable data pipelines and platforms to ingest, merge, and prepare structured and unstructured data for analytics and AI. Lead multidisciplinary teams, perform data exploration and statistical analysis, and support use of LLMs/GenAI to enable mission-driven solutions across fraud detection, healthcare, and intelligence domains.

Leads the design, development, administration, and optimization of enterprise data pipelines and Microsoft Fabric data platforms. Responsibilities include ETL/ELT architecture, medallion layers, data quality, CI/CD, infrastructure as code, security, hybrid connectivity, disaster recovery, performance optimization, and troubleshooting. The role also mentors engineers, establishes technical standards, supports architecture reviews, and provides senior-level guidance for secure, scalable, reliable data platform implementations.

Lead design and development of web UI and REST middleware within an Agile team. Define requirements and acceptance criteria, implement Java/Spring and Angular solutions, build CI/CD pipelines, work with Product Owner and testers, and produce/update design documentation.

The Data Engineer will develop data pipelines, manage complex data sets, and ensure data reliability while collaborating within an Agile/Scrum team.

Design, build, maintain, and optimize Spark and Scala ETL/ELT pipelines on AWS for terabyte- and petabyte-scale datasets. Work across S3, Snowflake, Kafka, and monitoring systems, resolve production data-quality and performance issues, write automated tests, participate in architecture and code reviews, and support on-call operations. Use generative AI to improve pipeline development, monitoring, and engineering productivity.

Leads Databricks lakehouse delivery across bronze, silver, and gold layers. Designs SAP and manufacturing data models, conformed dimensions, fact tables, governed datasets, and reusable outputs for reporting, forecasting, and AI/BI. Owns data quality, reconciliation, documentation, performance optimization, testing, and engineering delivery standards. Partners with architecture, BI, master data, product, application, and integration teams to onboard sources and deliver trusted data products.

Manages and evolves enterprise data lakes and warehouses, designing scalable AWS-based batch, CDC, and near-real-time ETL/ELT pipelines. Builds data quality, governance, lineage, security, monitoring, and recovery controls; optimizes Spark, Glue, Athena, Redshift, and S3 workloads. Develops reusable Python, SQL, and PySpark frameworks, supports schema evolution and analytical data modeling, and collaborates with business and technical stakeholders to deliver reliable data solutions.

Build complex ETL pipelines, databases, datasets, and data-quality processes using Python, SQL, Databricks, and cloud technologies. Develop Tableau and Power BI dashboards, operationalize data for mission decision-making, and collaborate with security and Agile teams. Apply CI/CD and DevSecOps practices to automate pipelines and validate models. Communicate analytical findings clearly while supporting cybersecurity, compliance, and operational insights for federal clients.

Lead architecture and hands-on engineering to design, scale, and govern a cloud-native lakehouse using Databricks and Microsoft Fabric. Build batch/streaming pipelines, ensure HIPAA-compliant PHI handling, produce analytics-ready datasets, mentor engineers, and drive platform strategy, governance, and reliability.

Designs and maintains enterprise data pipelines, warehouses, lakes, semantic models, ETL/ELT processes, and SQL solutions. Supports Power BI datasets and reporting architectures while ensuring data quality, governance, security, and performance. Collaborates with HR stakeholders, analysts, data scientists, and technology teams to translate business requirements into scalable technical solutions. The role also contributes to data architecture, troubleshooting, documentation, and engineering best practices.

Build and operate production-grade data pipelines and models connecting marketing, event, operational, and SaaS data into Databricks. Own data quality, testing, monitoring, lineage, orchestration, attribution, identity resolution, and governed semantic-layer contributions. Partner cross-functionally on privacy-aware data flows, event taxonomies, and reliable Growth data products while improving engineering standards and maintainability.

Plans and executes enterprise data migrations, conversions, transformations, archival, and cloud data platform operations. Builds ETL/ELT pipelines and migration scripts, performs profiling and source-to-target mapping, validates data, manages cutovers and rollback procedures, and troubleshoots migration issues. Optimizes cloud platforms, databases, workloads, security, access, cost, and performance while collaborating with engineering, governance, architecture, and business teams.

Develop and maintain large-scale, cloud-native data services and distributed pipelines for multi-tenant healthcare systems. Responsibilities include data modeling, database component development, SQL programming, performance tuning, testing, deployment, code reviews, proof-of-concepts, and full software development lifecycle ownership. Collaborate with global engineering teams, evaluate technologies, apply security and operational requirements, and use AI tools to accelerate development.

Leads the design, automation, optimization, and maintenance of scalable data pipelines using Airflow, dbt, Python, SQL, and Google Cloud technologies. Manages dbt models, develops reusable architecture patterns, monitors pipeline performance, supports CI/CD and testing, and ensures data security and governance. The role also provides technical leadership, mentors engineers, collaborates cross-functionally, documents implementations, and drives continuous improvement across data engineering practices.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.