Top Data Engineer Jobs in Richmond, VA

Designs, builds, and maintains Databricks data pipelines and analytics solutions using SQL and Python. Collaborates with development and IT teams, applies DevOps and CI/CD practices, supports Power BI dashboards, and contributes to data modeling, management, and governance. The role requires extensive Databricks and cloud-platform experience, strong communication skills, fluent English, and at least five years of relevant experience.

Build scalable data ingestion, transformation, and loading infrastructure using Spark, SQL, AWS, and Databricks. Develop entity resolution systems, CI/CD pipelines, anomaly detection, and high-quality data products. Design scalable processing and storage patterns, orchestration workflows, and data warehousing solutions while collaborating remotely and documenting technical designs.

Build and maintain Snowflake and dbt data models using medallion architecture, CDC ingestion, star schemas, and slowly changing dimensions. Develop governed semantic datasets for BI and AI workloads, implement testing, documentation, monitoring, alerting, row-level security, and performance tuning. Partner with product and business stakeholders to translate reporting needs into reliable multi-tenant SaaS data solutions.

Build and maintain scalable, fault-tolerant data pipelines, warehouses, and analytics solutions. Transform complex structured and semi-structured data, automate delivery processes, improve data quality and reliability, and support enterprise data strategies. Collaborate with analysts, data scientists, actuaries, and business teams to translate requirements into solutions. Research new technologies, troubleshoot issues, maintain version-controlled code, and mentor data engineering team members.

Designs and maintains scalable data models, semantic layers, ETL/ELT workflows, data-quality frameworks, and governed analytics products for commercial operations. Owns data solutions from requirements through deployment, monitoring, documentation, and support. Partners with technical and business stakeholders to deliver trusted reporting, dashboards, scorecards, productivity measurements, and AI-enabled decision support.

Own end-to-end client data migrations: reverse-engineer legacy ETL, design and build Airflow DAGs and Spark jobs, validate and reconcile data at scale, document architecture and decisions, and coordinate cross-functional teams through go-live and hypercare.

Designs, develops, maintains, and optimizes complex data systems, SQL databases, ETL processes, data warehouses, reports, and .NET applications supporting pharmacy benefit management. Responsibilities include database performance tuning, troubleshooting pharmacy claims processes, developing scalable solutions, documenting technical designs, participating in Agile ceremonies, collaborating with stakeholders, mentoring teammates, and ensuring healthcare data compliance.

Leads and develops a data engineering team implementing Navigate360 integrations for partner campuses. Oversees integration design, data mapping, validation, reconciliation, quality controls, delivery planning, and scalable implementation processes. Partners with Product, Launch, and Partner Success teams to resolve technical and partner challenges, improve adoption, manage project health, and ensure reliable outcomes. Provides technical mentorship, code and design review, stakeholder communication, and continuous process improvement.

Lead architecture, development, and optimization of a cloud-native data platform. Design high-volume batch and streaming pipelines, optimize data processing across AWS, Snowflake, Redshift, and Athena, and implement Iceberg-based data management. Establish security, privacy, observability, and DataOps practices while mentoring engineers, guiding technical direction, collaborating with data science teams, and delivering scalable petabyte-level data infrastructure.

Design, build, and maintain scalable big data pipelines, architectures, distributed databases, and storage systems. Use Python and frameworks such as Hadoop, Spark, or Flink for data integration, transformation, and processing. Ensure system performance, availability, security, governance, and data quality while collaborating with cross-functional teams and documenting technical solutions.

Design, build, deploy, and maintain AWS-based data and AI/ML infrastructure for enterprise agentic AI platforms. Develop data lake pipelines, observability systems, agent-enablement tooling, and production MLOps/LLMOps capabilities. Own features end-to-end, contribute to architecture and design decisions, optimize reliability, scalability, security, and cost, and collaborate with AWS Professional Services, client teams, and junior engineers.

Designs and productionizes hybrid knowledge graph solutions for healthcare and clinical data using LPG and RDF technologies. Builds FHIR transformation and ingestion pipelines, implements ontology mappings, entity linking, identifiers, provenance, validation, and graph queries with Cypher or SPARQL. Collaborates with ontology, terminology, FHIR, clinical, and data engineering teams, while contributing to architecture reviews, code reviews, testing, and engineering best practices.

Design, develop, and maintain Customer Data Platform solutions and data pipelines to create unified customer profiles, manage identity resolution, enable audience segmentation and activation, ensure data quality and governance, and support integrations with marketing, CRM, and cloud data systems.

Build customer-facing data products for the single-family rental market. Responsibilities include architecting real estate data models, designing reliable data pipelines and workflows, shaping data platform architecture, establishing engineering standards, and developing real estate domain expertise. The role partners with data science and product teams and requires leadership in scalable data engineering.

Designs and implements scalable data pipelines, cloud data platforms, storage solutions, and analytics infrastructure. The role focuses on Snowflake and AWS architecture, migrating legacy systems to cloud environments, developing Python and SQL data-processing logic, orchestrating workflows, and implementing Infrastructure-as-Code and CI/CD. The engineer also contributes to data governance, quality, observability, stakeholder communication, mentoring, and technical leadership.

Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.

Lead enterprise data engineering efforts supporting defense missions. Responsibilities include prioritizing technical tasks, mentoring engineers, conducting code reviews, translating government requirements into scalable data architectures, developing Databricks ETL/ELT pipelines with Python, PySpark, and SQL, troubleshooting pipeline performance and reliability, and documenting systems. The role collaborates with government stakeholders, product owners, data scientists, analysts, and technical teams to deliver secure, high-throughput data platforms and actionable insights.

Designs and maintains scalable Azure data pipelines and ETL/ELT solutions across data lakes, warehouses, lakehouses, streaming platforms, and enterprise sources. Builds integrations using Azure Data Factory, Synapse, Databricks, Spark, Kafka, and related services; applies security, governance, monitoring, and performance optimization practices. Develops Power BI dashboards, reports, data models, and visualizations, while supporting analytics and AI/ML use cases. Collaborates in Agile teams and automates deployments through DevOps and CI/CD practices.

Designs and automates data validation, profiling, testing, monitoring, and quality frameworks for multi-source cloud data. The role uses Azure Synapse, Databricks, SQL, Python, Scala, Collibra, and Profisee to detect anomalies, enforce governance, and improve data reliability. Responsibilities include developing automated test plans, analyzing structured and unstructured datasets, supporting Azure data engineering workflows, and collaborating with engineers, analysts, data scientists, and product teams. A Public Trust or Suitability/Fitness determination may be required.

Designs and operates data infrastructure for a clinical trial platform. Builds pipelines that extract, normalize, validate, and link information from clinical documents and publications into Aurora and GraphDB. Develops embeddings, vector search, RAG workflows, data-serving APIs, lineage tracking, and regulatory audit trails. The role also requires AWS-based orchestration, clinical data quality controls, biomedical knowledge graph modeling, and deployment automation using infrastructure-as-code and containerization.

Build and maintain data pipelines for network and operational telemetry, integrate DataMiner and other monitoring systems, create Power BI dashboards, configure monitoring metrics and alerts, automate reporting, analyze network performance and recovery events, and translate technical findings into actionable insights for technical and executive stakeholders.

Designs and delivers backend systems, APIs, data models, ETL workflows, data interactions, and user interfaces. Optimizes data operations for scalability, performance, integrity, and security while contributing to automated testing and CI/CD. Requires strong Python and Apache Spark experience, distributed computing knowledge, Agile experience, and data analysis skills. The role supports healthcare-focused digital services in a remote-first environment.

Lead Cohere’s Data Foundation pillar, managing a team responsible for the full data lifecycle. Own the roadmap, BigQuery warehouse, Airflow and Cloud Run orchestration, dbt modeling, Looker and API serving, Terraform infrastructure, governance, access controls, reliability, incident response, and data freshness SLAs. Lead development of an agentic analytics platform and evaluation framework, establish company-wide analytics standards, and partner with product, engineering, security, legal, and business teams.

Architect and lead enterprise data platforms, pipelines, and infrastructure using Spark, Databricks, and cloud technologies. Build scalable data models and dimensional schemas, establish governance and data quality frameworks, optimize performance and reliability, and implement monitoring. Partner with stakeholders to translate requirements into technical solutions, lead design reviews, mentor engineers, contribute to platform strategy, troubleshoot complex failures, and support hiring and team development.

Leads the architecture, development, and maintenance of scalable batch and real-time data pipelines, cloud data platforms, ETL/ELT workflows, and ML data infrastructure. Establishes standards for data quality, observability, lineage, governance, security, and modeling. Partners with data scientists, engineers, DevOps, and business stakeholders; evaluates technologies, drives technical initiatives, mentors engineers, and supports production-grade APIs and machine learning pipelines.