Top Data Engineer Jobs in Richmond, VA

Build and maintain scalable batch and streaming data pipelines, analytics warehouses, transformation layers, and dimensional data models. Perform SQL-based analysis, support dashboards and reporting, monitor data quality and delivery SLAs, troubleshoot incidents, and improve operational reliability. Collaborate with engineers, analysts, data scientists, and business stakeholders while contributing to documentation, governance, observability, and automation.

Build scalable data ingestion, transformation, and loading infrastructure using Spark, SQL, AWS, and Databricks. Develop entity resolution systems, CI/CD pipelines, anomaly detection, and data quality processes. Design scalable processing systems, orchestration workflows, storage patterns, and data warehouse solutions. Collaborate remotely, document technical designs, scope projects, and solve complex data engineering and data science problems.

Build and scale distributed data pipelines and architectures supporting AI products and research. Responsibilities include processing large datasets with Spark, designing AWS data systems, managing SQL and NoSQL storage, writing Python and SQL, ensuring data quality and reliability, and implementing automation, orchestration, monitoring, and scalable data operations.

Design, build, and operate scalable batch and streaming data pipelines, lakehouse and warehouse models, and data services. Own datasets end to end, improve Snowflake, Iceberg, Spark, and Flink performance and reliability, implement governance and observability, and support graph-serving data models. Partner with product and engineering teams, participate in on-call, review code and designs, and mentor junior engineers.

Designs, develops, deploys, and supports enterprise business intelligence solutions using Power BI and related visualization platforms. Builds semantic and dimensional models, dashboards, reports, and analytical solutions; applies statistical techniques to identify trends and performance drivers; and translates findings into recommendations. Partners with stakeholders and data engineering teams, establishes reporting standards, optimizes performance, supports modernization and certification, and provides technical guidance. The senior level may lead complex initiatives, review designs, and mentor analysts.

Build and maintain reliable data pipelines supporting money movement, fraud response, and client reporting. Integrate internal and external APIs, orchestrate workflows with Airflow on Kubernetes, and implement testing, monitoring, alerting, and observability. Debug production issues, document root causes, improve pipeline efficiency, collaborate with stakeholders, and contribute to technical designs. The role requires Python, SQL, Airflow, Snowflake, dbt, and GCP experience, with opportunities for increased end-to-end ownership.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Designs scalable data architectures, ELT/ETL pipelines, data models, quality frameworks, and self-service data platforms. Partners with engineering, product, program, leadership, and data science teams to translate business needs into technical solutions. The role includes end-to-end technical ownership, large-scale batch and streaming data processing, mentoring junior engineers, system optimization, and on-call support for platform stability.

Designs and optimizes Power BI dashboards, semantic models, datasets, DAX measures, and reporting solutions for identity governance and administration analytics. Partners with ETL engineers and stakeholders to validate Parquet data from Azure Synapse and SailPoint sources, establish data-quality checks, monitor refreshes, define KPIs, and document data lineage. Supports compliance reporting, access governance, audit readiness, certification metrics, and Zero Trust analytics.

Design and manage financial systems for accurate cashback calculations, build and maintain reconciliation processes, ensure data integrity for yield-bearing instruments, collaborate with compliance, and partner with cross-functional teams to improve financial system efficiency.

Own data pipelines into and out of the warehouse, dbt models, data integrity, governance, identity resolution, reverse ETL, and quality monitoring across growth, lifecycle, and brokerage data. Partner with product, marketing, and operations teams to establish data contracts, ensure accurate and timely business metrics, and support regulated financial data requirements.

Contributes to building and optimizing a large-scale data lake and reliable data pipelines for cybersecurity analytics. Responsibilities include data modeling, distributed processing, workload optimization, monitoring, observability, CI/CD, code reviews, and supporting MLOps. The role collaborates with senior engineers to improve processes and deliver cost-effective cloud data solutions.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Design and build scalable data infrastructure, including lakehouse architecture, ClickHouse deployments, ETL/ELT pipelines, and data models connecting Postgres with analytics systems. Establish data quality, observability, performance, cost, and reliability standards. Collaborate with product and engineering teams, define data contracts and specifications, support real-time analytics, and use AI-assisted coding and LLMs to accelerate pipeline development and transformation.

Supports ETL pipeline implementation, data ingestion, data quality validation, schema and RBAC configuration, database performance testing, interoperability testing, and production migration activities. Maintains metadata registries, documents ingestion defects and remediation recommendations, validates post-migration data, and maintains database scripts and pipeline code in version control. The position is fully remote and supports a federal data migration program.

Develop and deploy Databricks Delta Live Tables ETL pipelines in a cloud lakehouse environment. Aggregate, normalize, transform, and validate geospatial data from authoritative sources. Document ingestion results, data quality defects, remediation actions, and test outcomes. Maintain version-controlled code with peer reviews, support GIS-based spatial validation, and assist with interoperability testing. The role supports federal endangered-species data integration and requires proficiency in Python or Scala, SQL, data quality validation, schema documentation, and geospatial data concepts.

Design, build, and maintain scalable batch and streaming data pipelines, cloud infrastructure, and the Enterprise Data Hub. Partner with stakeholders to productionize ingestions, ensure data quality, implement metadata/catalog solutions, mentor junior engineers, and support analytics and ML workloads using cloud and big-data tooling.

Staff Data Engineer responsible for setting technical direction, architecting scalable data platforms, leading cross-functional initiatives, improving reliability and performance, and enabling AI-assisted analytics and development. The role includes hands-on development with Python, SQL, cloud data warehouses, orchestration, infrastructure as code, Kubernetes, Kafka, and streaming pipelines, along with mentoring, technical advocacy, documentation, code reviews, and on-call troubleshooting.

Data Engineer II will modernize BlueLabs’ data platform by leading Kimball dimensional modeling and legacy warehouse migrations, building reliable production data pipelines, and enforcing data quality standards. The role requires advanced SQL, Python, and dbt expertise, hands-on Snowflake and Redshift experience, and ownership of testing, documentation, observability, and scalable architecture. The engineer will collaborate cross-functionally, guide Data Engineer I team members, contribute to architectural decisions, and translate business logic into maintainable, cloud-agnostic data layers.

The AVP, Data Engineer will design and build data ingestion, transformation, and replication pipelines using SQL, Python, dbt, and Dagster. Responsibilities include translating requirements into technical designs, developing data products, debugging production issues, supporting testing, and improving data engineering practices. The role also involves data modeling, mentoring junior engineers, conducting code reviews, and providing technical leadership while remaining hands-on. Experience with modern data platforms, workflow orchestration, cloud ecosystems, and insurance or financial services is preferred.

Designs, builds, and optimizes scalable data pipelines, ETL workflows, integrations, and reporting solutions. Develops SQL, Python, and Spark data-processing solutions using Azure Data Factory and Microsoft Fabric, while monitoring production reliability and performance. Collaborates with stakeholders, participates in code reviews, documents technical solutions, mentors junior engineers, and improves engineering practices. Requires strong data modeling, cloud data platform, Git, communication, and problem-solving skills.

Design, develop, and maintain data pipelines, ETL processes, integrations, data infrastructure, and complex data models. Build and support data warehouses and analytics solutions using SQL, PL/SQL, Oracle, Snowflake, and cloud technologies. Collaborate with analysts, architects, developers, data scientists, and business stakeholders throughout the delivery lifecycle. Provide production support, troubleshoot issues, tune database performance, and contribute to data-driven reporting and AI tools.

Build and operate data-intensive web products and APIs, extend high-throughput ETL pipelines and scrapers, ensure reliability/observability, design self-scaling services, participate in code review, and collaborate across product, data, and infrastructure teams to meet production SLAs.

Design, build, and maintain scalable data pipelines, data lakes, and databases; ingest and map customer financial datasets; monitor pipeline reliability; translate business requirements into data flows and analytical insights to ensure high-quality, usable data.

Build and maintain ETL/ELT pipelines, ingest and transform structured and unstructured data, integrate APIs and external sources, improve data quality and monitoring, support dashboards and ML pipelines, optimize warehouse and cloud performance, and contribute to data governance and documentation.