Top Data Engineer Jobs in Richmond, VA

Lead development of a unified fleet knowledge model and decision-capture pipeline for autonomous data-center operations. Build data access layers across relational, telemetry, monitoring, and time-series systems; capture labeled operator decisions; negotiate data requirements with source-system owners; and own scaling considerations including vector indexing, schema evolution, retention, and analytics separation. The role requires strong infrastructure-domain modeling, PostgreSQL expertise, and experience handling time-series and event data at scale.

Own end-to-end production data platforms, writing Python and SQL, designing AWS pipelines, modeling analytics data, and implementing quality and reconciliation controls. Make architecture decisions independently, ensure correctness and auditability, and use AI coding tools effectively. The role also supports applied AI initiatives including entity resolution, LLM-assisted analytics, embeddings, and anomaly scoring.

Owns the end-to-end data platform, including Snowflake infrastructure, ingestion pipelines, Airflow orchestration, dbt transformations, governed gold-layer models, and metric definitions. Ensures reliability, performance, testing, documentation, governance, and CI/CD standards. Builds data systems from scratch, partners with analytics stakeholders, and uses AI-assisted development tools to accelerate engineering work. Requires strong SQL, platform ownership, software engineering practices, and experience with Snowflake, Airflow, and dbt.

Build and optimize data transformation pipelines using SQL, dbt, Airflow, Python, BigQuery, and relational databases. Collaborate with stakeholders and data engineers, manage task scheduling, resolve data issues, perform analyses, present recommendations, support data exploration tool adoption, and mentor team members. The role also contributes to hiring, onboarding, and professional development while ensuring data accuracy and insight quality.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, improving data-processing systems for quality, throughput, and cost, collaborating with AI scientists, and owning engineering projects through continuous improvement.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, developing reliable processing systems, optimizing data quality, throughput, and cost, and collaborating with AI scientists. The role requires ownership of engineering projects from discovery through continuous improvement in a distributed, ambiguous environment.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, developing reliable data acquisition and processing systems, optimizing quality, throughput, and cost, and collaborating with AI scientists. The role requires ownership of engineering projects from discovery through continuous improvement, with emphasis on backend development, production systems, and scalable data processing.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, processing petabyte-scale datasets, optimizing quality, throughput, and cost, collaborating with AI scientists, and owning engineering projects from discovery through continuous improvement.

Build and operate large-scale data pipelines that acquire, process, and improve audio datasets for AI model training. The role focuses on data quality, throughput, cost optimization, production systems, and collaboration with AI scientists. Responsibilities include discovering data sources, developing reliable processing systems, and owning engineering projects from discovery through continuous improvement.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, developing reliable data-processing systems, optimizing data quality, throughput, and cost, and collaborating with AI scientists. The role requires ownership of engineering projects from discovery through continuous improvement in a distributed, autonomous environment.

Build and operate large-scale data pipelines that collect, process, and optimize audio datasets for AI model training. The role involves discovering data sources, improving data quality, throughput, and cost efficiency, collaborating with AI scientists, and owning engineering projects from discovery through continuous improvement.

Designs and maintains secure, reliable data platforms, including relational data models, migrations, pipelines, monitoring, data quality processes, and self-service reporting access. The role protects PHI and PII through access controls, encryption, audit logging, and governance in a HIPAA environment. It also involves backend API development, code reviews, security reviews, stakeholder collaboration, and mentoring teams on data practices.

Own Moxie’s end-to-end data infrastructure, including pipelines, Snowflake warehousing, dbt and Omni modeling, orchestration, observability, and documentation. Partner with Engineering and Finance on schema changes, accounting logic, metrics, and business-critical reporting. Deliver financial or historical EMR data models, establish SOPs and reliability KPIs, optimize performance and cost, and help advance Practice Intelligence toward predictive and prescriptive products with appropriate AI safeguards.

Leads the architecture and evolution of scalable data platforms, pipelines, and data products across multiple teams. Designs Snowflake and cloud-based solutions for batch, streaming, CDC, ingestion, transformation, orchestration, and data delivery. Establishes engineering standards, governance, observability, testing, CI/CD, and reliability practices; mentors engineers; guides architecture and roadmap decisions; resolves complex incidents; and evaluates AI, automation, and MCP-enabled data capabilities.

Design and build cloud-agnostic Databricks Lakehouse architectures, scalable ETL/ELT pipelines, and production AI data workflows. Optimize Apache Spark performance, integrate MLflow for model deployment, and implement CI/CD and Infrastructure-as-Code using Terraform or Databricks CLI. Enforce governance, security, and compliance standards through Unity Catalog and cloud platforms. Collaborate with architects, scientists, product managers, and client engineering teams to deliver documented, production-ready solutions.

Build and own Snout’s data foundation, including PostgreSQL and dbt warehouses, ingestion pipelines, dimensional models, data quality, documentation, and reliable rebuilds. Reconcile data from veterinary practice-management systems, support LLM/AI tooling, translate stakeholder needs into technical plans, and establish the foundation for a future data team and analyst.

Design, develop, and operate large-scale data ingestion, transformation, enrichment, and processing pipelines across cloud, hybrid, and on-premises environments. Build distributed services using Java, Python, and Kafka; optimize data models and platform performance; deploy applications on Kubernetes; support infrastructure automation and CI/CD; troubleshoot production systems; and collaborate with customers and solution architects on implementations.

Designs, builds, and operates scalable batch and streaming data pipelines on Databricks for federal missions. Responsibilities include developing Spark and Delta Lake solutions, managing clusters and workflows, implementing Unity Catalog governance and security, optimizing ETL/ELT processes, integrating CI/CD, supporting machine learning and advanced analytics, monitoring data quality, and collaborating with technical teams and stakeholders.

Build and maintain production data ingestion pipelines, transformation models, warehouses, and schemas for PerfectServe’s data platform. Deploy reliable, tested pipelines using idempotency and data-quality checks, apply dimensional and medallion modeling, participate in design reviews, and document owned pipelines and runbooks. The role requires SQL, programming experience, dbt or similar transformation tools, cloud data warehouse experience, ELT orchestration, AWS knowledge, and a strong data-testing mindset.

Design, build, and own business-critical data pipelines and infrastructure across warehouses, orchestration, BI, and multiple regions. Develop AWS Glue and Spark jobs, data models, event contracts, observability, and batch or streaming architectures. Collaborate across producer and consumer teams, support Federal workloads, and operate production data platforms in government cloud environments.

Design, build, and scale data pipelines, ETL workflows, analytics infrastructure, and machine-learning data systems. Ensure data quality, security, monitoring, and reliability while optimizing storage and processing performance. Collaborate with engineering, product, and analytics teams on data requirements, modeling, schemas, and scalable infrastructure. The role also establishes data engineering best practices and supports a data-driven culture.

Lead the design and development of Azure-based big data solutions, including batch and real-time ETL/ELT pipelines, data architecture, ingestion, curation, warehousing, and storage. Build solutions using Azure Data Factory, Databricks, Synapse, Spark, Python, SQL, and related Azure services. Support Salesforce migration and integration while applying strong RDBMS, data management, and big data design expertise.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Lead the architecture and development of Vercel’s next-generation data platform, supporting batch and real-time integrations, analytics, data warehousing, and AI/ML workloads. Design scalable systems using Kafka, ClickHouse, Tinybird, and Snowflake; establish data governance and security standards; guide architectural decisions and roadmaps; collaborate with engineering, product, security, compliance, and leadership teams; write production code; and mentor engineers.

Design, develop, and maintain scalable ETL/ELT data integration pipelines supporting analytics, reporting, and product capabilities. Build ingestion, transformation, validation, and curated data layers; optimize production workflows; document systems; and implement data quality monitoring and testing. Collaborate with implementation, engineering, analytics, and customer success teams to resolve data issues, support onboarding, and ensure reliable, accessible data.