Top Senior Data Engineer Jobs in Richmond, VA

Designs, builds, and operates scalable cloud data pipelines, platforms, and applications. Responsibilities include data modeling, distributed data processing, relational and NoSQL database development, architecture decisions, observability, streaming pipelines, and data warehousing. The role leads large-scale data initiatives, evaluates technologies such as Snowflake and Databricks, collaborates with product and engineering teams, communicates technical concepts, and mentors data engineers.

Design, build, and operate scalable cloud data pipelines, platforms, and applications using distributed data technologies. Lead transformative data initiatives, make architectural decisions, evaluate platforms such as Snowflake and Databricks, and ensure reliability and maintainability. Collaborate with product managers, engineers, analysts, and data scientists while mentoring peers and communicating technical outcomes to stakeholders. Apply data modeling, relational and NoSQL databases, machine learning-enabled solutions, and modern cloud architectures to support risk management products.

Design, build, and operate scalable cloud data platforms, pipelines, and applications. Lead architectural decisions, establish reusable engineering patterns, evaluate technologies such as Snowflake and Databricks, and deliver distributed, real-time, and warehouse solutions. Collaborate with product, engineering, analytics, and data science teams while mentoring engineers and communicating technical outcomes to stakeholders.

Build and architect scalable cloud data solutions, pipelines, platforms, and data products. Lead large-scale data initiatives, make architecture and platform decisions, ensure performance and operational efficiency, and apply modern technologies such as Python, Spark, Databricks, and Snowflake. Collaborate with Agile teams, product managers, software engineers, analysts, and data scientists while mentoring engineers and communicating technical concepts to stakeholders.

Leads large-scale data engineering initiatives for Risk Tech, designing and delivering scalable cloud data platforms, pipelines, and applications. Responsibilities include architecture, data modeling, distributed processing, cloud warehousing, AI-enabled risk solutions, platform evaluation, operational resilience, and technical mentoring. The role collaborates with product managers, software engineers, analysts, and data scientists while independently driving architectural decisions and communicating technical outcomes to stakeholders.

Designs and leads scalable batch and real-time data pipelines supporting AI/ML applications, LLMs, RAG workflows, predictive models, and executive data products. Responsibilities include data architecture, feature stores, governance, security, lineage, performance and cost optimization, and cross-functional technical leadership. The role partners with data scientists, program managers, executives, and engineering teams to deliver reliable enterprise data solutions.

Build and lead scalable cloud data platforms, pipelines, and applications for enterprise risk management. The role involves designing data architecture, developing with Python and Spark, working with relational and NoSQL databases, and evaluating platforms such as Snowflake and Databricks. Responsibilities include delivering large-scale data initiatives, ensuring resilience and operational efficiency, mentoring engineers, enforcing design patterns, and communicating technical concepts to stakeholders. The position requires substantial experience in distributed data, SQL, application development, data modeling, cloud platforms, and pipeline engineering.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Designs, builds, and maintains secure data pipelines, ETL processes, data warehouses, and quality controls. Collects, validates, cleanses, and analyzes data; develops SQL queries, Tableau dashboards, and AWS-based solutions; investigates data integrity issues; documents standards; and partners with stakeholders to deliver technical solutions using Agile and DevOps practices.

Leads enterprise data engineering strategy and architecture for pipelines, external data sharing, and scalable data platforms. Designs and codes critical data solutions while driving adoption of modern technologies, governance, resiliency, operational excellence, and unified data architecture. Advises stakeholders, mentors engineers, recruits talent, evaluates emerging data and AI technologies, and develops platform roadmaps. The role requires hands-on expertise across AWS, lakehouse architecture, streaming, distributed computing, data warehousing, and multiple programming languages.

Build and own scalable data platforms and ingestion pipelines using BigQuery, dbt, and modern ingestion tools. Design batch and CDC workflows, improve reliability and observability, implement governance and access controls, and support analytics and AI agents. Develop Python services and internal tooling, contribute to architecture and lakehouse experiments, collaborate with stakeholders, and mentor engineers. The role requires strong SQL, Python, cloud infrastructure, testing, CI/CD, and AI-assisted development experience.

Designs, builds, and maintains Snowflake-based enterprise data warehouse solutions, including data architecture, ETL/ELT pipelines, security, deployment, data quality, modeling, and performance optimization. Partners with integration, analytics, governance, business intelligence, and architecture teams. Supports production operations, resolves ingestion and transformation issues, develops AWS-to-Snowflake scripts, documents implementations, and translates business requirements into scalable data solutions.

Designs, develops, and maintains scalable data pipelines, data warehouses, databases, and analytical systems. Responsibilities include ETL implementation, data modeling, performance monitoring, troubleshooting, infrastructure optimization, process automation, and collaboration with cross-functional teams to support reporting and analytics. Requires 5+ years of data engineering experience and a relevant bachelor’s degree. Financial services experience is preferred.

Leads the design, development, and optimization of scalable data pipelines and analytics platforms. Builds ETL/ELT workflows using Databricks and Spark, integrates and transforms source data into curated models, manages SQL Server data, and maintains documentation and lineage. Collaborates with product, analytics, and engineering teams to deliver reliable data solutions. Applies responsible AI practices and delivers projects independently within established timelines.

Build and maintain secure data pipelines and integrations across business platforms, laboratory systems, analytical instruments, and messy data sources. Own schema design, orchestration, monitoring, quality controls, documentation, and compliant data isolation for export-controlled information. Create a unified lakehouse foundation supporting analytics, dashboards, machine learning, R&D, manufacturing, and operations. Partner with scientists and technical teams to integrate HPLC, GC, Invert Bio, APIs, spreadsheets, PDFs, and semi-structured records.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Own Eve’s data platform end to end, including ingestion, orchestration, incremental dbt models, Snowflake administration, Terraform infrastructure, observability, access controls, and pipeline reliability. Build schema-change detection, freshness SLAs, CI environments, and incident processes while managing performance and compute costs. Partner with analytics engineers and stakeholders to maintain trusted data for reporting and AI systems, using AI-assisted development and documenting platform standards.

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.

Design, build, and operate scalable batch and streaming data pipelines, lakehouse and warehouse models, and data services. Own datasets end to end, improve Snowflake, Iceberg, Spark, and Flink performance and reliability, implement governance and observability, and support graph-serving data models. Partner with product and engineering teams, participate in on-call, review code and designs, and mentor junior engineers.

Design, build, deploy, and maintain AWS-based data and AI/ML infrastructure for enterprise agentic AI platforms. Develop data lake pipelines, observability systems, agent-enablement tooling, and production MLOps/LLMOps capabilities. Own features end-to-end, contribute to architecture and design decisions, optimize reliability, scalability, security, and cost, and collaborate with AWS Professional Services, client teams, and junior engineers.

Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.

Build and own Snout’s data foundation, including PostgreSQL and dbt warehouses, ingestion pipelines, dimensional models, data quality, documentation, and reliable rebuilds. Reconcile data from veterinary practice-management systems, support LLM/AI tooling, translate stakeholder needs into technical plans, and establish the foundation for a future data team and analyst.

Design, develop, and operate large-scale data ingestion, transformation, enrichment, and processing pipelines across cloud, hybrid, and on-premises environments. Build distributed services using Java, Python, and Kafka; optimize data models and platform performance; deploy applications on Kubernetes; support infrastructure automation and CI/CD; troubleshoot production systems; and collaborate with customers and solution architects on implementations.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Lead the architecture and development of Vercel’s next-generation data platform, supporting batch and real-time integrations, analytics, data warehousing, and AI/ML workloads. Design scalable systems using Kafka, ClickHouse, Tinybird, and Snowflake; establish data governance and security standards; guide architectural decisions and roadmaps; collaborate with engineering, product, security, compliance, and leadership teams; write production code; and mentor engineers.