Top Data Engineer Jobs in Washington, DC

Leads Databricks lakehouse delivery across bronze, silver, and gold layers. Designs SAP and manufacturing data models, conformed dimensions, fact tables, governed datasets, and reusable outputs for reporting, forecasting, and AI/BI. Owns data quality, reconciliation, documentation, performance optimization, testing, and engineering delivery standards. Partners with architecture, BI, master data, product, application, and integration teams to onboard sources and deliver trusted data products.

Manages and evolves enterprise data lakes and warehouses, designing scalable AWS-based batch, CDC, and near-real-time ETL/ELT pipelines. Builds data quality, governance, lineage, security, monitoring, and recovery controls; optimizes Spark, Glue, Athena, Redshift, and S3 workloads. Develops reusable Python, SQL, and PySpark frameworks, supports schema evolution and analytical data modeling, and collaborates with business and technical stakeholders to deliver reliable data solutions.

Build complex ETL pipelines, databases, datasets, and data-quality processes using Python, SQL, Databricks, and cloud technologies. Develop Tableau and Power BI dashboards, operationalize data for mission decision-making, and collaborate with security and Agile teams. Apply CI/CD and DevSecOps practices to automate pipelines and validate models. Communicate analytical findings clearly while supporting cybersecurity, compliance, and operational insights for federal clients.

Builds and maintains scalable data pipelines and cloud infrastructure supporting an AI biomedical research platform. Responsibilities include ingesting, harmonizing, validating, and documenting multimodal neurodegeneration datasets; managing cloud storage, compute, permissions, and costs; implementing de-identification and data governance workflows; supporting research data repositories and AI/ML teams; and maintaining data lineage, catalogs, and technical documentation. The role requires strong Python and SQL skills, software engineering discipline, cloud experience, and neurodegeneration research data expertise.

Lead architecture and hands-on engineering to design, scale, and govern a cloud-native lakehouse using Databricks and Microsoft Fabric. Build batch/streaming pipelines, ensure HIPAA-compliant PHI handling, produce analytics-ready datasets, mentor engineers, and drive platform strategy, governance, and reliability.

Design, build, and maintain ETL pipelines, databases, and data models to process healthcare claims and related data. Ensure data quality, analyze claims data for trends, and produce reports and visualizations for nontechnical stakeholders. Collaborate with policy and analytics teams to translate requirements into data solutions and improve data infrastructure and analytics capabilities.

Collects, consolidates, cleans, analyzes, and visualizes experimental data from analytical equipment, test rigs, and pilot plants. Performs statistical analysis, anomaly detection, experimental design support, equipment validation, and QA/QC activities. Presents findings to technical leadership, identifies process improvements, and helps extract actionable insights from structured and spectral data.

Build and operate production-grade data pipelines and models connecting marketing, event, operational, and SaaS data into Databricks. Own data quality, testing, monitoring, lineage, orchestration, attribution, identity resolution, and governed semantic-layer contributions. Partner cross-functionally on privacy-aware data flows, event taxonomies, and reliable Growth data products while improving engineering standards and maintainability.

Develop and maintain large-scale, cloud-native data services and distributed pipelines for multi-tenant healthcare systems. Responsibilities include data modeling, database component development, SQL programming, performance tuning, testing, deployment, code reviews, proof-of-concepts, and full software development lifecycle ownership. Collaborate with global engineering teams, evaluate technologies, apply security and operational requirements, and use AI tools to accelerate development.

Build and scale an enterprise metrics store, dbt models, semantic-layer definitions, and analytical workflows. Develop governed business metrics, root-cause analysis, metric relationships, and reusable logic for BI tools. Partner with product, engineering, sales, underwriting, claims, and experience teams to translate business questions into actionable insights. Improve data quality, define data contracts, debug upstream and analytical issues, and help prepare metric infrastructure for API-based serving.

Lead pre-sales technical engagements to design and optimize scalable cloud lakehouse data platforms (Snowflake/Databricks). Provide architecture reviews, ETL/ELT pipeline design, governance and AI-ready data foundations, support services sales, and translate technical tradeoffs into actionable recommendations for engineering and executive stakeholders.

Participate in an internship focused on database modeling and optimization, data analysis and consolidation, data quality, and data support. Work alongside experienced professionals on real-world projects while developing technical and professional skills. The program requires prior knowledge of data concepts, spreadsheets, databases, programming logic, and analytical problem-solving.

Leads the design, automation, optimization, and maintenance of scalable data pipelines using Airflow, dbt, Python, SQL, and Google Cloud technologies. Manages dbt models, develops reusable architecture patterns, monitors pipeline performance, supports CI/CD and testing, and ensures data security and governance. The role also provides technical leadership, mentors engineers, collaborates cross-functionally, documents implementations, and drives continuous improvement across data engineering practices.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.

Build and maintain low-latency, highly available distributed data systems and services to deliver high-quality data for product, analytics, and ML. Partner with data scientists and product teams to design scalable, observable, multi-tenant data products using batch and real-time processing frameworks. Ensure 24x7 reliability, monitoring, and operational excellence while owning end-to-end delivery.

Design, build, and own large-scale batch and streaming data pipelines and core Ads data products. Collaborate with analytics, data science, and engineering teams to model, transform, govern, and deliver high-quality ad datasets for analysis, ML, and reporting while ensuring privacy compliance.

Build scalable, privacy-focused data frameworks and ETL pipelines using big-data technologies (Spark, Presto, Flink, Kafka, Hive). Ensure appropriate handling of personal data, support privacy and legal needs, partner cross-functionally, and lead system design while mentoring teammates.

Designs and leads scalable data platforms, event-driven services, orchestration pipelines, and DataOps practices using Python, Airflow, Snowflake, Kafka, and related technologies. The role establishes engineering standards, governance, security, observability, cost efficiency, and AI-assisted development practices. It also mentors engineers, drives cross-functional initiatives, modernizes data ingestion, and ensures reliable, compliant, and well-governed systems.

Owns the end-to-end design and development of a greenfield data and AI platform for federal background investigations. Responsibilities include lakehouse architecture, ingestion and transformation pipelines, Terraform infrastructure, CI/CD, governance, cataloging, lineage, access control, compliance with FedRAMP and NIST requirements, artifact promotion, platform reliability, cost management, and enabling data science and machine learning teams.

Lead database engineering for a federal species-data integration program in a hybrid AWS cloud environment. Responsibilities include harmonizing schemas, documenting source-to-target mappings and lineage, enforcing metadata and data-quality standards, implementing encryption and NIST-aligned security controls, building authoritative source registries, optimizing performance, and leading production migration, validation, monitoring, and operational documentation. The role requires Databricks or equivalent lakehouse expertise, ETL programming, federal governance knowledge, and database migration leadership.

Designs secure Azure data pipelines and analytics foundations using Databricks and ADLS Gen2. Responsibilities include modernizing Oracle workloads, developing medallion data models, implementing data quality and monitoring practices, integrating curated datasets with Power BI, and establishing secure Azure Government identity, network, storage, and access patterns. The role also requires documentation, operational support, stakeholder collaboration, and performance optimization.

Build and maintain centralized pricing data infrastructure, scalable workflows, and data pipelines; integrate AI capabilities; deliver pricing tools, reporting, and governance to support data-driven pricing and budgeting across the firm.

Leads data engineering strategy and mentors an analytics engineering team. Designs scalable ELT pipelines, warehouse integrations, data models, API ingestion workflows, and data quality frameworks using cloud and database technologies. Conducts exploratory analysis, supports dashboards and analytical solutions, monitors warehouse performance and costs, and ensures data governance, security, and compliance. Collaborates with data scientists, analysts, engineers, and business stakeholders to deliver healthcare analytics solutions.

Own SQL and dbt-based data modeling and data quality for clinical and claims datasets. Author and refactor dbt models/tests, triage DQ alerts, design monitors, optimize SQL performance, and collaborate with Data Engineering and stakeholders to ensure trusted production datasets.

The job involves building responsive web dashboards, advanced data visualizations, and analytics tools for unmanned aircraft systems, requiring a deep understanding of UI/UX design and data presentation.