Top Senior Data Engineer Jobs in Richmond, VA

Build and guide data platform capabilities supporting marketing, finance, analytics, and data science. Develop data collection, integration, scoring, experimentation, analytics, and infrastructure solutions; contribute code, lead cross-functional technical initiatives, improve system resiliency through incident response, and establish engineering standards. Partner with business and technical stakeholders to define strategy and long-term roadmaps.

Builds business-critical dashboards, scorecards, reports, and ad hoc analyses using SQL, Python, Excel, Power BI, and Tableau. Analyzes KPIs, identifies trends and root causes, automates recurring reporting, validates data, and translates complex findings into actionable insights for stakeholders and leadership. The role collaborates with data engineers and cross-functional teams to improve reporting workflows, data pipelines, and decision-making.

Lead financial data engineering initiatives involving commissions, incentive programs, and backend financial systems. Build scalable, accurate, and reliable data pipelines, platform tooling, partner integrations, analytics infrastructure, and data science infrastructure. Shape technical strategy and roadmaps, collaborate with Finance, Product, Data Science, and Engineering, mentor engineers, contribute code, lead incident response, and establish engineering standards.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Designs, develops, and maintains scalable cloud-based data pipelines and enterprise data solutions. The role covers data ingestion, transformation, orchestration, integration, data lakes, cloud warehouses, batch and streaming processes, performance optimization, governance, and lineage. The Senior Data Engineer collaborates with analysts, data scientists, engineers, stakeholders, contractors, and vendors while mentoring junior staff. Core tools include Databricks, dbt, Azure Data Factory, SQL, Python, and Azure.

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.

Build and scale secure data lakehouse and warehouse infrastructure supporting analytics, machine learning, clinical AI performance monitoring, and self-service insights. Develop scalable data pipelines, models, orchestration, quality controls, and LLM-enabled analytics tools using heterogeneous clinical and EHR data. Collaborate with engineering, data science, clinical, product, and client success teams to establish trustworthy metrics and technical solutions.

Design, build, and operate production data pipelines using Python, Spark SQL, and Airflow. Canonicalize healthcare and customer data into trusted internal models, optimize distributed processing, enforce schemas, and implement quality checks and observability. Support customer onboarding, streaming pipelines, troubleshooting, on-call operations, and platform best practices while collaborating with product, analytics, engineering, data science, and customer teams.

Own the analytics data layer by translating stakeholder needs into certified dimensional models, governed metrics, semantic layers, dashboards, and reports. Build with dbt, SQL, Databricks, Power BI, and Airflow while ensuring data quality, observability, reconciliation, documentation, and dependable orchestration. Partner closely with finance, operations, and client-facing teams, automate recurring workflows, and use AI-assisted engineering practices in a fully remote environment.

Own the technical design and operation of Palmetto’s governed data platform. Build trusted data products, semantic models, ingestion and transformation pipelines, secure access interfaces, and agent-ready data services. Establish governance, masking, authorization, observability, CI/CD, and audit readiness. Partner with finance, operations, product, and engineering teams while mentoring engineers and setting cross-team technical direction.

Designs, builds, and maintains Databricks data pipelines and analytics solutions using SQL and Python. Collaborates with development and IT teams, applies DevOps and CI/CD practices, supports Power BI dashboards, and contributes to data modeling, management, and governance. The role requires extensive Databricks and cloud-platform experience, strong communication skills, fluent English, and at least five years of relevant experience.

Build scalable data ingestion, transformation, and loading infrastructure using Spark, SQL, AWS, and Databricks. Develop entity resolution systems, CI/CD pipelines, anomaly detection, and high-quality data products. Design scalable processing and storage patterns, orchestration workflows, and data warehousing solutions while collaborating remotely and documenting technical designs.

Designs, develops, maintains, and optimizes complex data systems, SQL databases, ETL processes, data warehouses, reports, and .NET applications supporting pharmacy benefit management. Responsibilities include database performance tuning, troubleshooting pharmacy claims processes, developing scalable solutions, documenting technical designs, participating in Agile ceremonies, collaborating with stakeholders, mentoring teammates, and ensuring healthcare data compliance.

Leads and develops a data engineering team implementing Navigate360 integrations for partner campuses. Oversees integration design, data mapping, validation, reconciliation, quality controls, delivery planning, and scalable implementation processes. Partners with Product, Launch, and Partner Success teams to resolve technical and partner challenges, improve adoption, manage project health, and ensure reliable outcomes. Provides technical mentorship, code and design review, stakeholder communication, and continuous process improvement.

Design, build, deploy, and maintain AWS-based data and AI/ML infrastructure for enterprise agentic AI platforms. Develop data lake pipelines, observability systems, agent-enablement tooling, and production MLOps/LLMOps capabilities. Own features end-to-end, contribute to architecture and design decisions, optimize reliability, scalability, security, and cost, and collaborate with AWS Professional Services, client teams, and junior engineers.

Designs and productionizes hybrid knowledge graph solutions for healthcare and clinical data using LPG and RDF technologies. Builds FHIR transformation and ingestion pipelines, implements ontology mappings, entity linking, identifiers, provenance, validation, and graph queries with Cypher or SPARQL. Collaborates with ontology, terminology, FHIR, clinical, and data engineering teams, while contributing to architecture reviews, code reviews, testing, and engineering best practices.

Build customer-facing data products for the single-family rental market. Responsibilities include architecting real estate data models, designing reliable data pipelines and workflows, shaping data platform architecture, establishing engineering standards, and developing real estate domain expertise. The role partners with data science and product teams and requires leadership in scalable data engineering.

Designs and implements scalable data pipelines, cloud data platforms, storage solutions, and analytics infrastructure. The role focuses on Snowflake and AWS architecture, migrating legacy systems to cloud environments, developing Python and SQL data-processing logic, orchestrating workflows, and implementing Infrastructure-as-Code and CI/CD. The engineer also contributes to data governance, quality, observability, stakeholder communication, mentoring, and technical leadership.

Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.

Lead enterprise data engineering efforts supporting defense missions. Responsibilities include prioritizing technical tasks, mentoring engineers, conducting code reviews, translating government requirements into scalable data architectures, developing Databricks ETL/ELT pipelines with Python, PySpark, and SQL, troubleshooting pipeline performance and reliability, and documenting systems. The role collaborates with government stakeholders, product owners, data scientists, analysts, and technical teams to deliver secure, high-throughput data platforms and actionable insights.

Designs and maintains scalable Azure data pipelines and ETL/ELT solutions across data lakes, warehouses, lakehouses, streaming platforms, and enterprise sources. Builds integrations using Azure Data Factory, Synapse, Databricks, Spark, Kafka, and related services; applies security, governance, monitoring, and performance optimization practices. Develops Power BI dashboards, reports, data models, and visualizations, while supporting analytics and AI/ML use cases. Collaborates in Agile teams and automates deployments through DevOps and CI/CD practices.

Designs and operates data infrastructure for a clinical trial platform. Builds pipelines that extract, normalize, validate, and link information from clinical documents and publications into Aurora and GraphDB. Develops embeddings, vector search, RAG workflows, data-serving APIs, lineage tracking, and regulatory audit trails. The role also requires AWS-based orchestration, clinical data quality controls, biomedical knowledge graph modeling, and deployment automation using infrastructure-as-code and containerization.

Designs and delivers backend systems, APIs, data models, ETL workflows, data interactions, and user interfaces. Optimizes data operations for scalability, performance, integrity, and security while contributing to automated testing and CI/CD. Requires strong Python and Apache Spark experience, distributed computing knowledge, Agile experience, and data analysis skills. The role supports healthcare-focused digital services in a remote-first environment.

Lead Cohere’s Data Foundation pillar, managing a team responsible for the full data lifecycle. Own the roadmap, BigQuery warehouse, Airflow and Cloud Run orchestration, dbt modeling, Looker and API serving, Terraform infrastructure, governance, access controls, reliability, incident response, and data freshness SLAs. Lead development of an agentic analytics platform and evaluation framework, establish company-wide analytics standards, and partner with product, engineering, security, legal, and business teams.

Architect and lead enterprise data platforms, pipelines, and infrastructure using Spark, Databricks, and cloud technologies. Build scalable data models and dimensional schemas, establish governance and data quality frameworks, optimize performance and reliability, and implement monitoring. Partner with stakeholders to translate requirements into technical solutions, lead design reviews, mentor engineers, contribute to platform strategy, troubleshoot complex failures, and support hiring and team development.