Top Data Engineer Jobs in Washington, DC

Lead design and implementation of enterprise data architecture and cloud-based data solutions. Manage large data engineering projects, develop data models and pipelines, ensure governance and security compliance, advise clients strategically, and build high-performing inclusive teams.

Build and operate production-grade ELT pipelines from product, Salesforce, and third-party systems into Snowflake using dbt. Ensure testing, monitoring, schema versioning, governance, privacy, access controls, data quality, cost, and performance. Support AI initiatives with trusted data, contribute to warehouse and semantic-layer architecture, and translate cross-functional stakeholder needs into scalable data solutions.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Design and build data infrastructure, pipelines, and transformations using Azure Data Factory, Azure Databricks, and Snowflake. Develop data architecture and modeling, maintain data lakes/warehouses, ensure data quality and security, optimize performance, and collaborate with clients to deliver tailored data solutions and governance.

Lead design and implementation of scalable data infrastructure, pipelines, and transformations using cloud platforms. Build and optimize data warehouses (Snowflake, Databricks), orchestrate workflows (Airflow, Hadoop), ensure data quality and security, and coach teams to deliver analytics solutions that drive tax practice insights and client outcomes.

Lead design and implementation of data infrastructure, pipelines, and warehouses using Azure Data Factory, Databricks, and Snowflake. Manage data modeling, quality, security, and analytics frameworks. Lead client accounts, mentor teams, and drive innovation to deliver data-driven business insights.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Configure and maintain Adobe Experience Platform and Real-Time CDP data pipelines, XDM schemas, datasets, identity resolution, Profile enablement, segmentation readiness, and destination activation. Validate data quality, troubleshoot ingestion and identity issues, manage sandboxes, and implement privacy, consent, governance, and access controls. Partner with architects, data engineers, consultants, analysts, data scientists, and marketing teams to support reporting, personalization, and machine learning readiness.

Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.

Design, build, and maintain scalable data pipelines and platforms. Implement ETL/ELT workflows, parse and process structured/unstructured data, and support data platform scaling, monitoring, and operations while working on cross-functional agile teams.

Design, build, and maintain scalable Databricks-based data pipelines. Implement ingestion, transformation, orchestration, quality, and DevOps practices. Ensure reliability, observability, performance, documentation, and collaborate with stakeholders and mission teams to support production data systems.

Supports ETL pipeline development, legacy data migration, data transformation, validation, profiling, cleaning, and integration for a secure DEA modernization program. Collaborates with technical and business teams, monitors pipeline performance, troubleshoots issues, documents data flows and migration results, and participates in Agile development activities under senior engineer guidance.

Designs and maintains scalable ETL pipelines for structured and unstructured data, supporting DEA legacy-data migration, validation, integration, and modernization. The role improves data quality, interoperability, reliability, and cloud-platform performance while preparing data for analytics and AI/ML use cases. Responsibilities include source-to-target mapping, troubleshooting, documentation, stakeholder collaboration, and participation in Agile development.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Design, build, and optimize end-to-end data pipelines and dataflows, integrate with AWS, maintain schemas/data dictionaries, provide Tier 3 support, collaborate with stakeholders and product teams, document architectures, and support off-hours deployments. Ensure data governance, scalability, and production readiness while working primarily on-site in a cleared defense environment.

As the first in-house Data Engineer, you will own the data infrastructure, build and maintain data pipelines, and collaborate with teams to ensure quality data access and insights.

Build and maintain cloud cost monitoring, alerting, and optimization tooling. Develop automation, cost allocation/tagging, data pipelines, dashboards, and integrations with billing APIs. Support FinOps processes, implement cost guardrails, troubleshoot cost systems, participate in on-call rotation, and collaborate with senior engineers and product teams to drive cost-efficient infrastructure and reporting.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Build, deploy, and maintain secure, scalable data pipelines and analytics on AWS/Databricks. Implement CI/CD, governance (Unity Catalog, lineage), platform observability, and operational support for enterprise datasets and Databricks SQL reporting.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

The Senior IT Data Engineer will design and implement enterprise data architectures, develop scalable ETL/ELT pipelines, and support data-driven initiatives for the Federal Reserve Board.

Design, build, and maintain scalable ETL/data pipelines and an authoritative Lakehouse using Databricks and cloud platforms. Collaborate on data platform strategy, implement CI/CD, model data, refresh dashboards, apply advanced analytics (LLMs/AI) to unstructured data, and support post-award reporting to improve grant program outcomes.

Design, build, and maintain scalable data pipelines, data lakes, and databases; ingest and map customer financial datasets; monitor pipeline reliability; translate business requirements into data flows and analytical insights to ensure high-quality, usable data.

The Staff Data Engineer will lead design and implementation of analytics platforms and data products, collaborate cross-functionally, mentor engineers, and drive best practices at Upside.

Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.