Top Senior Data Engineer Jobs in Richmond, VA

Designs, builds, administers, and supports cloud data architectures, databases, schemas, metadata repositories, ETL processes, and analytic models. Leads data quality, governance, troubleshooting, testing, automation, reporting, dashboards, and infrastructure design. Collaborates with Agile teams to translate business requirements into technical capabilities and supports decision-making for Audit and business management. The role is full-time onsite at an eligible Federal Reserve location and requires extensive security screening.

Lead technical strategy and architectural evolution in marketing technology, mentoring teams and driving innovative solutions across data engineering and platforms.

Design, implement, and manage advanced data ecosystems and scalable ETL/ELT pipelines. Analyze complex problems, deliver data warehousing and governance solutions, mentor junior staff, and build client relationships while maintaining high standards and business-context awareness.

Lead design and implementation of enterprise data architecture and cloud-based data solutions. Manage large data engineering projects, develop data models and pipelines, ensure governance and security compliance, advise clients strategically, and build high-performing inclusive teams.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Leads technical strategy for enterprise data pipelines and data-sharing platforms. Builds scalable, resilient, high-performance systems using AWS, lakehouse architecture, Kafka, Flink, Spark, Snowflake, and Databricks. Develops code, drives engineering excellence and technology adoption, influences enterprise stakeholders, advises on platform capabilities, mentors engineers, and recruits technical talent. The role requires deep data engineering and architecture expertise, hands-on leadership, and innovation across internal and external data environments.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Lead development of scalable data pipelines and cloud-based data solutions using Python, SQL, Spark, Kafka, Snowflake, and Databricks. Responsibilities include data modeling, data quality, governance, testing, performance optimization, technical design, collaboration with Agile teams and product managers, and mentoring engineers. The role supports omnichannel marketing and messaging platforms while encouraging adoption of emerging technologies and interactive AI tools.

Designs, builds, administers, and troubleshoots cloud data architectures, databases, schemas, metadata repositories, ETL processes, and analytic models. Ensures data integrity and quality, develops SQL queries and reports, leads testing and automation improvements, and supports dashboards, governance, data sharing, and metric collection. Collaborates with Agile teams to translate business requirements into technical infrastructure designs and decision-support capabilities using AWS, Java, Python or Scala, GitLab, and Terraform.

Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.

Lead and mentor a data engineering team to design, build, test, and deploy cloud-based, AI-enhanced risk management data solutions. Collaborate across Agile teams and product managers, implement big-data and streaming systems, perform unit tests and code reviews, and drive technology adoption and performance tuning.

As a Senior Lead Data Engineer, you will design, develop, and support data solutions, optimize systems, and collaborate within Agile teams to leverage technology for business transformations.

Supports, maintains, troubleshoots, and optimizes production Databricks applications, Spark jobs, SQL queries, Delta Lake pipelines, clusters, workflows, and data quality processes. Responsibilities include platform configuration, observability, documentation, deployment support, technical testing, finance data engineering, stakeholder coordination, and incremental improvements. The role also contributes to reporting enablement, operational readiness, process improvement, and on-call support during EST business hours.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Builds and maintains scalable data pipelines, ETL infrastructure, data warehouses, and analytics tools. The role assembles complex datasets, automates processes, optimizes data delivery architecture, and supports cross-functional data initiatives. Collaborates with executive, product, data, and design stakeholders to resolve technical issues and improve analytics systems. Requires proficiency in SAS, Python, Java, MATLAB, SQL, NoSQL, Hadoop, MapReduce, Hive, Presto, UNIX, and Linux, with JavaScript, R, and basic machine learning preferred.

Design, build, and maintain Keboola-based data pipelines integrating multiple business systems to deliver accurate, scalable data for supply chain, logistics, and transportation analytics; collaborate with analysts and engineers; support documentation, governance, and pipeline automation.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

Designs scalable Databricks solutions and ETL/ELT pipelines while administering MariaDB and SQL Server environments. Responsibilities include database design, performance tuning, backup and disaster recovery, security and access management, data modeling, quality and lineage, and troubleshooting complex data issues. The role collaborates with stakeholders and technical teams, translates requirements into secure solutions, provides technical direction, and delivers demonstrations and training for Department of Transportation support.

Designs and operates an AWS-native lakehouse supporting analytics, reporting, visualization, and AI/ML. Builds batch and streaming ingestion pipelines using Python and PySpark, Apache Iceberg data structures, governance and metadata services, quality controls, security, observability, and CI/CD automation. Optimizes performance, scalability, reliability, and cost while collaborating with cross-functional technical teams and documenting architecture, operations, and secure configurations.

Lead Data Engineer responsible for designing, developing, testing, implementing, and supporting cloud-based data solutions. Collaborate across Agile teams, work with distributed systems, big data and streaming tools, data warehousing, and mentor engineers. Ensure code quality via unit tests and performance tuning, and partner with product managers to deliver scalable data experiences.

Lead and mentor a data engineering team to design, develop, test, and support cloud-based big data and streaming solutions. Build full-stack data pipelines using Java/Scala/Python, RDBMS/NoSQL, Redshift/Snowflake, and cloud platforms. Collaborate with product managers, perform unit tests and code reviews, and promote engineering best practices and tech community engagement.

Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.