Top Data Engineer Jobs in Richmond, VA

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Design and manage financial systems for accurate cashback calculations, build and maintain reconciliation processes, ensure data integrity for yield-bearing instruments, collaborate with compliance, and partner with cross-functional teams to improve financial system efficiency.

Manage, design, and optimize data activities for federal IAM systems. Develop data models, file layouts, source-to-target mappings, data dictionaries, integrations, ETL processes, and analytics support for identity analysis and fraud detection. Administer and tune databases, including configuration, backups, monitoring, capacity planning, and performance optimization. Support secure handling of identity and PII data, network-related data flows, documentation, token management processes, and collaboration across development, security, and operations teams.

Design, build, and maintain data warehouse infrastructure, semantic/dimensional models, metrics layer, and BI dashboards (Sigma, Power BI, Databricks). Build secure ELT pipelines, enforce governance and row-level security (Entra ID), enable self-service analytics and AI/ML integrations, triage BI issues, train stakeholders, and collaborate in Agile to deliver reliable, performant reporting and curated data products.

Build and maintain ETL/ELT pipelines, ingest and transform structured and unstructured data, integrate APIs and external sources, improve data quality and monitoring, support dashboards and ML pipelines, optimize warehouse and cloud performance, and contribute to data governance and documentation.

Lead and mentor a data engineering team to design, build, test, and support cloud-based data solutions. Develop distributed, real-time and batch data pipelines using Java/Scala/Python, NoSQL and RDBMS, and cloud data warehousing (Redshift/Snowflake). Collaborate with product managers and Agile teams to deliver performant, production-ready systems.

Build and maintain production-grade data pipelines and ELT processes using Python, SQL, Airflow, and dbt within AWS. Design optimized schemas in PostgreSQL and Redshift, leverage AI/LLMs to improve development, automation, testing, and data quality, and scale infrastructure for large healthcare datasets.

Design, build, and maintain Keboola-based data pipelines integrating multiple business systems to deliver accurate, scalable data for supply chain, logistics, and transportation analytics; collaborate with analysts and engineers; support documentation, governance, and pipeline automation.

Support design, development, and maintenance of data pipelines and infrastructure. Assist with ETL/ELT workflows, data ingestion, cleaning, validation, modeling, and warehousing. Document processes and collaborate with data teams to support analytics use cases.

Design, build, and maintain cloud-based data pipelines and architectures on AWS/Azure/GCP. Advise clients on cloud data strategies, collaborate with stakeholders, implement production data products, and articulate architectural trade-offs.

Design, build, and maintain scalable data pipelines, data lakes, and databases; ingest and map customer financial datasets; monitor pipeline reliability; translate business requirements into data flows and analytical insights to ensure high-quality, usable data.

Designs, develops, and maintains scalable data pipelines and workflows using Matillion, HVR, and Databricks. Performs data modeling, SQL-based transformation, ETL/ELT optimization, and data quality management. Collaborates with data scientists, analysts, architects, and business data owners to translate requirements into secure, governed data solutions. Documents processes and ensures compliance with security and regulatory standards, including U.S. government cloud requirements.

The Snowflake Data Engineer will work on data cleansing and harmonization, moving from legacy systems to SAP S4, focusing on ETL/ELT development and view creation.

This role involves designing, building, and maintaining data pipelines on Snowflake. Responsibilities include ensuring data quality and collaborating with stakeholders to deliver solutions.

The AWS Data Engineer will work on a data cleansing and harmonization project, focusing on AWS ETL design and development using various AWS services.

The Snowflake Data Engineer will design, build, and maintain data pipelines on Snowflake, optimizing performance and ensuring data quality while collaborating with stakeholders.

The Snowflake Data Engineer and Product Owner will manage the Snowflake data analytics project, collaborating with stakeholders, leading Agile practices, and ensuring quality deliverables through effective team coordination and backlog management.

Build and maintain ETL/ELT data pipelines and storage for batch and real-time use. Partner with product and engineering to define requirements, ensure data quality, monitor pipeline health, integrate cloud data warehouses/lakes, optimize SQL/Python transformations, and document data flows and architecture.

Lead architecture and reliability of the data platform, build and harden ingestion (batch and CDC), own BigQuery+dbt transformations, establish testing/observability/governance, mentor engineers, develop Python tooling and APIs, run POCs for lakehouse/open table formats, and define AI-assisted development practices.

Design, build, and maintain scalable batch and streaming data pipelines, cloud infrastructure, and the Enterprise Data Hub. Partner with stakeholders to productionize ingestions, ensure data quality, implement metadata/catalog solutions, mentor junior engineers, and support analytics and ML workloads using cloud and big-data tooling.

Maintain and monitor Snowflake data warehouse and ingestion pipelines. Troubleshoot file/load/data quality issues, operate SFTP/drop-zone/file automation, support scheduled loads, build dbt models and tables, document runbooks, and serve as backup for core warehouse operations while collaborating with engineering and IT.

Lead and mentor engineering teams to design, build, test, and support cloud-based data solutions. Work with big data, streaming, and data warehousing technologies, collaborate with product managers, and ensure performant, well-tested code and architectures.

Lead and mentor a team of data engineers to design, develop, test, implement, and support cloud-based data platforms and full-stack solutions. Build distributed, real-time, and batch data systems using Java/Scala/Python, big data tools (Spark, Hadoop, Kafka), NoSQL and RDBMS, and data warehouses (Redshift, Snowflake). Collaborate with Agile teams, perform unit tests and code reviews, and drive technology experimentation and transformation.

The role involves architecting and improving data systems, defining governance standards, optimizing performance, and mentoring engineers in data engineering.