Top Senior Data Engineer Jobs in Richmond, VA

Design, build, and own business-critical data infrastructure, including AWS Glue and Spark pipelines, cloud warehouse or lakehouse systems, orchestration, and Tableau BI platforms. Define event-driven contracts, data models, schemas, observability, and batch or streaming architectures across multi-tenant, multi-region environments. Collaborate across producer and consumer teams while owning production data infrastructure and outcomes end to end.

Design and support ETL, data migration, transformation, import, export, and validation workflows for moving legacy EHR data into athenahealth systems. Build Python and SQL utilities, define source-to-target mappings, support HL7 and FHIR interoperability, validate EHI exports, investigate data quality issues, document processes, and collaborate with product, implementation, operations, sales, and engineering teams in a remote environment.

Design, build, and operate scalable PostgreSQL databases and cloud-native data infrastructure. Build and maintain ETL/ELT pipelines, optimize query and server performance, ensure high availability and disaster recovery, improve observability, troubleshoot production issues, guide schema and application design, evaluate database technologies, and mentor junior engineers to support reliable, secure data-driven applications.

Own the go-to-market data infrastructure, integrating HubSpot, Dreamdata, advertising platforms, PostHog, and website data into BigQuery. Diagnose tracking and attribution discrepancies, configure multi-touch revenue attribution, and build executive dashboards covering channel performance and revenue. Develop ABM workflows using Clay, enrichment, behavioral signals, and AI personalization. Partner with sales and marketing to improve funnel visibility, campaign decisions, and outbound effectiveness.

Own data ingestion, validation, reconciliation, and quality pipelines using Python, advanced SQL, and PostgreSQL. Design schemas, indexes, migrations, automated tests, and CI/CD workflows while handling unreliable third-party feeds. Develop test plans, track defects, establish quality metrics, conduct performance and security testing, and support compliance documentation. Preferred experience includes AWS event-driven architectures, healthcare or payer data, orchestration tools, infrastructure as code, FedRAMP environments, data quality frameworks, and anomaly detection.

Designs, develops, and maintains Databricks-based ETL pipelines, data lake architectures, datasets, and data quality processes supporting reporting, analytics, and AI/ML workloads. Maintains and migrates legacy SSIS and SQL Server systems, optimizes pipeline performance, and supports complex SSRS reporting. Collaborates with business users, analysts, and IT teams to define data requirements, troubleshoot issues, document solutions, and advance AI-assisted engineering practices.

Designs, develops, and maintains Databricks ETL pipelines, data lake architectures, datasets, and data integrations supporting reporting, analytics, and AI/ML workloads. Troubleshoots and optimizes Databricks and SSIS processes, maintains legacy systems, implements data quality controls, and supports data warehousing. Maintains SSRS reports and collaborates with business users, analysts, and IT teams to deliver reporting solutions. Documents work, communicates technical information, and contributes to AI-assisted development practices.

Build scalable data pipelines, ELT processes, infrastructure, and dimensional data models supporting internal analytics and customer-facing data products. Implement data quality monitoring, auditing, alerting, warehouse optimization, and governed semantic layers for AI and LLM-enabled analytics. Partner with technical and business stakeholders, improve data processes using AI, and deliver reliable metrics from diverse data sources.

Design, build, and optimize enterprise ETL/ELT pipelines, cloud data lakes, lakehouse solutions, data models, and semantic layers across AWS and Azure. Ensure data quality, security, performance, reliability, and governance while supporting analytics, reporting, and AI initiatives. Collaborate with product, engineering, IT, and business stakeholders to translate requirements into scalable data solutions, monitor pipeline health, troubleshoot issues, and improve data architecture and practices.

Lead data engineering and machine learning initiatives by designing, architecting, developing, and supporting GCP data pipelines. Create information architecture documentation, estimate and plan technical work, collaborate with project teams and business analysts, and translate requirements into technical designs. Develop Python-based ELT pipelines, optimize BigQuery SQL, support CI/CD, and provide technical leadership to projects and teams.

Design, build, deploy, and operationalize scalable data engineering solutions for customers. Responsibilities include developing pipelines, transforming and cleansing data, analyzing sources, implementing governance, security, and quality practices, testing data movement and transformation code, resolving defects and incidents, and advising customers on technical decisions. The role also supports AI, machine learning, business intelligence, and data product adoption while collaborating across teams and educating end users.

Designs and develops enterprise cloud data solutions, including batch, near-real-time, and API-based pipelines. Builds data models, warehouses, lakes, and lakehouses while implementing governance, quality, lineage, and curation practices. Supports CI/CD, testing, monitoring, observability, security, and compliance. Collaborates with architects, product owners, analysts, and leadership on platform strategy and modernization. Mentors engineers, leads reviews, presents technical topics, and explores AI-enabled data capabilities.

Lead Salesforce data migration and quality activities for a Department of Veterans Affairs modernization program. Analyze SQL Server data, create source-to-target mappings, execute ETL and Salesforce loading, validate and reconcile records, implement data quality controls, and develop migration and application test plans. Track defects, support automated monitoring and testing, collaborate with architects, developers, stakeholders, and provide migration status, risk, and quality updates.

Build and own the data platform backbone: design ingestion patterns, Snowflake warehouses, governance, and freshness strategy. Implement reliable batch and streaming pipelines, data quality, observability, and onboarding processes. Lead legacy migrations, create data contracts and SLAs, and apply AI-native tooling to automate debugging, documentation, and operational workflows while partnering with Analytics, Engineering, and vendors.

Lead design and ownership of a modern data platform: ingestion, Snowflake governance, pipeline reliability, migrations, data contracts, observability, and AI-enabled tooling. Partner with Analytics, Engineering, and vendors to deliver trustworthy data products and operate production pipelines.

Design and build Snowflake transformation layer and migrate legacy SQL to versioned dbt models. Define conformed dimensions/facts using Kimball principles, set modeling and CI/CD standards, implement data quality/lineage, support BI migration and AI/ML readiness, and mentor future hires. Hands-on work in dbt, SQL, and Python with stakeholder collaboration and governance for financial and operational data.

Own and optimize data infrastructure and ETL/ELT pipelines using SSIS and Microsoft Fabric. Build and maintain SQL Server data warehouse staging, transformations, and lakehouse ingestion. Implement CI/CD, version control with GitHub, monitor pipeline health, troubleshoot data issues, document data flows, and translate stakeholder requirements into data engineering solutions that support BI reporting.

Lead design and implementation of cloud-based data pipelines and distributed data systems. Advise clients on best practices, partner with stakeholders to translate requirements, provide technical leadership and mentorship, and maintain scalable ETL, warehousing, and streaming solutions across cloud platforms.

Design, build, and maintain scalable data pipelines and tenant-aware APIs to ingest and transform data from varied sources. Work with event-driven and batch architectures, implement authentication and integration patterns, ensure observability/monitoring, optimize data flows for cost and performance, and collaborate with product, infrastructure, and engineering teams to onboard and maintain data sources at scale.

Responsible for designing, developing, and maintaining scalable data pipelines and infrastructure, implementing data governance, and collaborating with teams to meet data needs.

Lead design and scaling of ELT pipelines and analytics schemas on Snowflake. Build Looker views, CI/CD automation, and orchestration workflows (Prefect/Airflow). Ensure production reliability with monitoring (Datadog, Monte Carlo), partner with cross-functional teams, and provide technical leadership including code reviews, testing, and end-to-end ownership of data integrity and platform trustworthiness.

Leads data engineering strategy, architecture, delivery, support, and lifecycle management for secure, scalable cloud and hosted data solutions. Collaborates with technical and business stakeholders to deliver complex datasets, establish enterprise data standards, manage data engineering teams, and oversee maintenance, change management, capacity planning, business continuity, disaster recovery, and regulatory security requirements. The role also evaluates third-party tools and supports Azure DevOps, SDLC, CI/CD, and technical innovation.

Design, build, and optimize scalable cloud data pipelines and infrastructure. Maintain and refactor SQL and ETL processes, automate data workflows, ensure data quality/security, and troubleshoot complex issues. Provide technical leadership and mentor junior engineers while collaborating with stakeholders to translate requirements.

The Senior Data Engineer will develop data engineering solutions, manage ETL workflows, and establish a new data practice while collaborating with stakeholders.

The Lead Data Platform Engineer will design and build Virtuous's data platform, ensuring it is secure, scalable, and AI-ready. Responsibilities include architecting access controls, optimizing performance, and enabling self-service analytics while maintaining governance and compliance standards.