Top Data Engineer Jobs in Richmond, VA

Designs, builds, and maintains secure data pipelines, ETL processes, data warehouses, and quality controls. Collects, validates, cleanses, and analyzes data; develops SQL queries, Tableau dashboards, and AWS-based solutions; investigates data integrity issues; documents standards; and partners with stakeholders to deliver technical solutions using Agile and DevOps practices.

Leads enterprise data engineering strategy and architecture for pipelines, external data sharing, and scalable data platforms. Designs and codes critical data solutions while driving adoption of modern technologies, governance, resiliency, operational excellence, and unified data architecture. Advises stakeholders, mentors engineers, recruits talent, evaluates emerging data and AI technologies, and develops platform roadmaps. The role requires hands-on expertise across AWS, lakehouse architecture, streaming, distributed computing, data warehousing, and multiple programming languages.

Support design, development, and maintenance of data pipelines and infrastructure. Assist with ETL/ELT workflows, data ingestion, cleaning, validation, modeling, and warehousing. Document processes and collaborate with data teams to support analytics use cases.

Build and deliver Azure and Microsoft Fabric data solutions for clients. Responsibilities include developing data pipelines with Azure Databricks, Data Factory, Synapse Analytics, and Fabric; writing SQL, Python, and PySpark; supporting data integration, testing, deployments, troubleshooting, CI/CD, and infrastructure management. The role involves consulting with client stakeholders, collaborating with architects and developers, and delivering modern data platforms and reporting solutions.

Leads enterprise data platform architecture, engineering standards, technical decisions, and development of scalable data products. Designs batch and streaming systems, governance, observability, security, and reliability practices. Partners cross-functionally, mentors engineers, drives modernization and migrations, and establishes reusable patterns for data modeling, orchestration, quality, and platform operations.

Design and maintain Snowflake-based data platforms, cloud-native data lakes, and scalable ETL/ELT pipelines for asset-backed finance analytics. Orchestrate workflows with Dagster and AWS services, ensure data reconciliation and integrity, and support migration from legacy systems. Contribute to project planning, Jira backlog management, testing, cutover planning, and cross-functional go-live readiness.

Design and maintain Snowflake data pipelines and data lake architectures for asset-based finance analytics. Develop ETL/ELT workflows, validate and reconcile financial data, migrate legacy systems, and translate quantitative finance logic into scalable architectures. Support project execution through requirements breakdown, planning, testing, cutover, and go-live readiness. Collaborate across engineering, quantitative analytics, and stakeholder teams.

Builds and maintains data pipelines and datasets supporting analytics, AI, and modeling. Responsibilities include ingesting healthcare claims and lab data into Snowflake and AWS Iceberg, processing structured and unstructured sources, curating data for AI use cases, implementing medallion architectures, evaluating data quality, and contributing to pilot initiatives using SQL, Python, AWS Glue, Terraform, and Snowflake.

Build and maintain production data pipelines and foundational datasets for Market Intelligence. Automate survey ingestion, cleaning, joining, scheduling, monitoring, and reporting-layer integration. Develop repeatable queries, improve data quality practices, document assumptions, support reproducible outputs, and translate research needs into technical solutions. The role requires close collaboration with technical and nontechnical stakeholders and ownership of reliable data infrastructure.

Design, build, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, SQL, Spark, and Delta Lake. Develop transformations, orchestration workflows, data models, validation processes, and curated data products. Troubleshoot performance and quality issues, apply governance and security practices, document solutions, and collaborate with architects, data scientists, DevOps teams, analysts, and clients.

Designs, develops, and maintains scalable ETL/ELT pipelines and data platform capabilities for high-volume healthcare data. Responsibilities include complex SQL development, Airflow orchestration, dbt transformations, data quality frameworks, pipeline monitoring, troubleshooting, performance optimization, and documentation. The role collaborates with Data Operations, Product, Analytics, Data Science, and clinical teams to deliver reliable data for analytics, reporting, product features, and AI/ML initiatives.

Build and maintain FinOps data pipelines, BigQuery and dbt models, cost attribution systems, forecasting and anomaly detection models, and cost-versus-revenue analytics. Identify and implement AWS and GCP savings opportunities, automate governance with Python, Terraform, and Lambda, and partner with Engineering, Finance, Product, and leadership on cloud costs, forecasting, reporting, and architecture decisions.

Designs, develops, maintains, and improves software applications and business processes. Responsibilities include full lifecycle development, troubleshooting, performance and reliability improvements, CI/CD collaboration, requirements analysis, technology research, package maintenance, portfolio planning, and mentoring junior engineers. The role requires independent work, cross-functional collaboration, and strong software development, documentation, and problem-solving skills.

Build and maintain scalable Python-based data pipelines and cloud-native solutions supporting U.S. Army financial-system modernization. Develop ETL/ELT workflows using AWS Glue, Lambda, S3, and CloudWatch; integrate APIs and diverse file formats; improve data reliability, performance, security, and governance; implement testing and monitoring; and collaborate with engineers and stakeholders in an Agile environment.

Designs, develops, maintains, and optimizes complex data systems, SQL/ETL processes, reporting solutions, and .NET applications supporting pharmacy benefit management. Responsibilities include database performance tuning, data warehousing, troubleshooting pharmacy claims, technical specification development, software testing, cloud integration, stakeholder collaboration, Agile participation, and mentoring. The role requires strong SQL Server, dimensional modeling, cloud database, Python, PowerShell, and healthcare data standards expertise.

Designs and optimizes scalable data platforms, architectures, and production pipelines supporting AI and machine learning. Responsibilities include Databricks Lakehouse development, batch and real-time processing, data governance, security, monitoring, performance tuning, infrastructure planning, and collaboration with DevOps, MLOps, and cross-functional teams. The role serves as the AI team’s data engineering subject matter expert and ensures reliable, secure, cost-effective data solutions.

Develop and maintain data pipelines, infrastructure, and integrations supporting analytics, data science, and business intelligence. Ensure data quality and integrity, optimize workflows, and collaborate with Operations, IT, Accounting, HR, Property Services, Marketing, and other departments. The role requires SQL Server, programming, shell scripting, cloud, containerization, version control, and data pipeline knowledge, with occasional travel and flexible scheduling as project deadlines require.

Leads the design, development, and optimization of scalable data pipelines and analytics platforms. Builds ETL/ELT workflows using Databricks and Spark, integrates and transforms source data into curated models, manages SQL Server data, and maintains documentation and lineage. Collaborates with product, analytics, and engineering teams to deliver reliable data solutions. Applies responsible AI practices and delivers projects independently within established timelines.

Design, build, and optimize scalable data pipelines, warehouses, lakes, and processing systems for analytics and business intelligence. Ensure data quality, security, reliability, and cost efficiency while collaborating with data scientists, analysts, and engineers. Maintain technical documentation, support Databricks solutions, and apply emerging data engineering technologies. The role requires strong programming, SQL, ETL, orchestration, data modeling, cloud, and big data expertise.

Architects and leads enterprise data engineering platforms, including scalable ETL/ELT pipelines, streaming frameworks, cloud infrastructure, data warehouses, and AI/ML data systems. Establishes engineering standards, governance, monitoring, data quality, security, and schema management practices. Designs AI agents using LLMs, partners across business and infrastructure teams, and makes high-impact architectural decisions for reliable, secure, multi-region data environments.

Administer and enhance Edmunds’ Databricks data platform and AWS infrastructure. Build and maintain ETL pipelines, infrastructure-as-code tooling using Terraform or CDK, and operational dashboards, alerts, and reports. Collaborate with business, engineering, analytics, security, and infrastructure teams to support data platform users and AI solutions. Evaluate new technologies, troubleshoot platform issues, and improve operational, cost, and security visibility.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Designs, builds, tests, and maintains scalable data infrastructure and ETL/ELT pipelines for mission partners. Uses AWS Glue, Glue Catalog, and Step Functions to integrate, migrate, transform, and validate data. Develops data models, schemas, queries, and production-ready datasets while collaborating with analytics and business teams. The role may also support AI/ML pipelines, data governance, DevOps workflows, Databricks, and real-time streaming architectures.

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.

Lead pre-sales technical engagements to design and optimize scalable cloud lakehouse data platforms (Snowflake/Databricks). Provide architecture reviews, ETL/ELT pipeline design, governance and AI-ready data foundations, support services sales, and translate technical tradeoffs into actionable recommendations for engineering and executive stakeholders.