Top Data Engineer Jobs in Washington, DC

Build ETL pipelines, perform data quality analysis, design databases, and manipulate large datasets using Python, SQL, Databricks, and cloud technologies. Develop Tableau and Power BI dashboards, curate datasets, automate data and feature pipelines, and support CI/CD and DevSecOps practices. Partner with security and Agile teams to define data requirements, operationalize analytics, communicate findings, and deliver decision-ready insights for mission-critical stakeholders.

Designs, builds, and maintains cloud data pipelines and ETL/ELT processes supporting VA healthcare analytics. Responsibilities include patient matching, record linkage, data harmonization, quality management, documentation, performance optimization, and pipeline support. Collaborates with analysts and stakeholders to develop scalable solutions and Power BI reports using Databricks SparkSQL. The role requires federal healthcare data experience, strong SQL or Spark SQL skills, and the ability to obtain a VA Public Trust clearance.

Supports the design and development of scalable end-to-end data pipelines and cloud data platforms. Responsibilities include improving data reliability and quality, implementing data management practices, supporting automation and process improvements, ensuring secure and cost-effective solutions, and recommending system enhancements. The intern collaborates with global teams and gains hands-on experience in data engineering, project coordination, and innovation management.

The Principal Data Engineer designs and builds scalable cloud-native data platforms, pipelines, frameworks, and governed data products supporting analytics, reporting, AI, and operational workloads. Responsibilities include Databricks, Spark, Delta Lake, Azure, SQL Server, batch and streaming processing, data integration, performance optimization, governance, modernization, troubleshooting, architecture reviews, and mentorship. The role provides senior technical leadership without direct people management and supports insurance-domain data across policy, claims, billing, finance, and regulatory functions.

Build and configure a government Databricks workspace, develop ingestion pipelines from enterprise systems, and prepare data for reporting. Implement Unity Catalog governance, metadata, auditing, and lineage; configure MLflow workflows; assess security controls for sensitive data; and create architecture documentation, data dictionaries, and operating procedures. The role also requires integrating legacy systems, optimizing Delta Lake pipelines, and supporting long-term platform sustainment.

Designs and maintains ELT pipelines, warehouse integrations, data models, and data quality processes. Collaborates with data scientists, analysts, engineers, and stakeholders to deliver scalable analytical solutions. Responsibilities include data integration, governance, security, performance optimization, exploratory analysis, visualization, and cloud-based API ingestion. Requires strong SQL, DBT, Snowflake, Azure Data Factory, cloud, and scripting experience, plus leadership and communication skills.

Design, build, test, and maintain cloud-based data pipelines and ETL processes using Python, Databricks and Spark. Develop SQL queries and dashboards, automate workflows, integrate code with GitHub/GitLab CI/CD, troubleshoot data quality, and collaborate with stakeholders to deliver scalable, secure data solutions.

Build and maintain production data pipelines, Airflow DAGs, Snowflake infrastructure, and Data Vault 2.0 models. Ensure data quality, observability, security, governance, reliability, and cost efficiency through automated testing and CI/CD. Lead technical projects end-to-end, collaborate with stakeholders, and support SOX-relevant reporting while developing expertise in commercial insurance data and processes.

The Forward Deployed Data Engineer will manage AI-automated data platform migration projects, ensuring timely delivery and communication with clients while utilizing proprietary tools.

Designs scalable Databricks solutions and ETL/ELT pipelines while administering MariaDB and SQL Server environments. Responsibilities include database design, performance tuning, backup and disaster recovery, security and access management, data modeling, quality and lineage, and troubleshooting complex data issues. The role collaborates with stakeholders and technical teams, translates requirements into secure solutions, provides technical direction, and delivers demonstrations and training for Department of Transportation support.

Build and maintain batch and streaming data pipelines using Databricks, Spark, PySpark, and SQL. Develop AI-assisted ingestion, data-quality repair, document extraction, and human-review workflows. Manage Delta Lake storage, Unity Catalog metadata, geospatial processing, governance, lineage, orchestration, monitoring, CI/CD, and production support. Collaborate with architects and data scientists to operationalize a governed lakehouse platform for pipeline asset integrity data.

Manage Oracle and PostgreSQL databases across on-premises and AWS environments, including upgrades, migrations, performance tuning, security, and backup recovery. Design and maintain ETL pipelines using Talend, SQL, Power Automate, and related tools. Perform data profiling, quality analysis, governance, and cloud migration activities. Create technical architecture and lineage documentation while supporting regulated, audit-ready data platforms and integrations.

Build and operate reliable ETL and ELT pipelines across lakehouse and transactional systems. Develop data models, enforce governance, integrate diverse data sources, and support analytics, APIs, and predictive tools. Monitor performance, data quality, lineage, cost, and uptime while collaborating with data science, AI, product, and innovation teams.

Build and maintain cloud cost monitoring, alerting, and optimization tooling. Develop automation, cost allocation/tagging, data pipelines, dashboards, and integrations with billing APIs. Support FinOps processes, implement cost guardrails, troubleshoot cost systems, participate in on-call rotation, and collaborate with senior engineers and product teams to drive cost-efficient infrastructure and reporting.

Lead the Ads Signals & Measurement data engineering team across conversion and attribution, measurement foundations, audience onboarding, and identity. Set cross-organizational technical direction, resolve scalable data architecture decisions, mentor engineers, and partner on platform-wide initiatives. The role requires expertise in modern data stacks, advertising technology data flows, privacy and governance, distributed systems, and emerging AI technologies.

Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.

Build and maintain ETL/ELT pipelines, ingest and transform structured and unstructured data, integrate APIs and external sources, improve data quality and monitoring, support dashboards and ML pipelines, optimize warehouse and cloud performance, and contribute to data governance and documentation.

Supports ETL pipeline development, legacy data migration, data transformation, validation, profiling, cleaning, and integration for a secure DEA modernization program. Collaborates with technical and business teams, monitors pipeline performance, troubleshoots issues, documents data flows and migration results, and participates in Agile development activities under senior engineer guidance.

Designs and maintains scalable ETL pipelines for structured and unstructured data, supporting DEA legacy-data migration, validation, integration, and modernization. The role improves data quality, interoperability, reliability, and cloud-platform performance while preparing data for analytics and AI/ML use cases. Responsibilities include source-to-target mapping, troubleshooting, documentation, stakeholder collaboration, and participation in Agile development.

Develops and maintains HCM dashboards, APIs, data pipelines, and analytical products for USDA modernization initiatives. Translates business requirements into secure, scalable data solutions; supports migration planning, data quality, governance, metadata, systems integration, testing, validation, and Databricks Lakehouse architecture. Responsibilities also include requirements analysis, UAT coordination, documentation, training, and lifecycle management of HCM data products.

Design, develop, and optimize enterprise-scale data platforms, pipelines, data lakes, warehouses, and analytical datasets on Azure and Snowflake. Build ETL/ELT processes using ADF, Databricks, PySpark, SQL, Python, and Snowflake. Manage data models, governance, security, quality, CI/CD, cloud migrations, and performance optimization. Collaborate with stakeholders, troubleshoot production issues, document solutions, and support Agile delivery.

Support design, development, and maintenance of data pipelines and infrastructure. Assist with ETL/ELT workflows, data ingestion, cleaning, validation, modeling, and warehousing. Document processes and collaborate with data teams to support analytics use cases.

Designs, builds, and manages cloud-based data systems, including pipelines, data lakes, warehouses, lakehouses, databases, and ETL processes. Develops optimized Python and SQL queries, improves workflow performance, and supports data movement between on-premises and cloud environments. Collaborates with leadership, analysts, research teams, and other departments to define requirements and reporting needs. Applies data governance, access controls, security, compliance, troubleshooting, and system support practices.

Build and maintain automated data pipelines, ETL/ELT workflows, integrations, migration processes, and CI/CD automation for USDA’s HCM modernization initiative. Responsibilities include data mapping, transformation, cleansing, validation, reconciliation, testing, monitoring, and exception handling. Support Databricks Lakehouse architecture, security, common data models, reporting, analytics, and DevSecOps practices while coordinating mock migrations and UAT.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.