Top Data Engineer Jobs in Richmond, VA

Design, build, and maintain scalable ETL and data pipelines on AWS using Python/PySpark. Develop Glue/Lambda/Step Function workflows, event-driven integrations, and data lake/warehouse solutions. Tune SQL, implement monitoring/validation, support API/JSON integrations, troubleshoot operations, document and automate deployments, and mentor junior engineers.

Support building and maintaining ETL pipelines using Python and PySpark. Work with AWS services (Glue, Lambda, Step Functions, S3, Redshift, RDS, EMR) to ingest, transform, and validate data. Write complex SQL, implement basic monitoring/logging, process API/JSON payloads, and collaborate with engineers, analysts, and stakeholders on deployment and documentation.

Design and implement scalable data pipelines and orchestration on GCP to support AI/ML-driven mail intelligence. Build stream and batch processing, ensure data governance and quality, optimize workflows, create visualizations, and collaborate with US cross-functional teams to align technical strategy and recover from failures.

Design, develop, maintain, and optimize ADABAS database structures and data solutions. Support mainframe data processing (Natural, COBOL, JCL), perform migrations to modern platforms, tune performance, ensure data integrity/security, troubleshoot issues, and collaborate with developers, architects, and analysts on modernization, API/cloud integration, and data warehousing initiatives.

Lead and mentor multiple Databricks-focused data engineering teams, define engineering best practices and reusable frameworks, drive CI/CD and performance/cost optimization, build and support analytical and streaming pipelines, and collaborate with architects, product owners, and cross-functional partners to deliver high-quality data products.

Design and maintain ELT/ETL pipelines and cloud data warehouse models, build Power BI reports, apply AI tools to accelerate data workflows, and partner with business stakeholders to deliver reliable analytics and data governance.

The Senior Data Engineer will design and maintain data pipelines, provide technical leadership, and work with cloud platforms like AWS, Azure, and GCP.

Design and maintain data pipelines using cloud technologies. Provide technical leadership, implement data engineering solutions, and mentor engineers. Collaborate with stakeholders and stay updated on cloud advancements.

Analyze large and diverse datasets to uncover insights, develop/train/deploy machine learning models, design data preprocessing pipelines, and create visualizations and reports. Collaborate with cross-functional teams to build predictive models, recommendation systems, and optimization algorithms to drive business improvements.

Design, implement, and optimize Snowflake data storage and ETL solutions. Write and tune SQL, integrate data sources and BI tools, ensure data security and compliance, and collaborate with teams to meet business objectives.

Develop and maintain Python-based data applications and pipelines: fetch data from databases/APIs/files, build Pandas DataFrames/NumPy arrays, write complex SQL and data transformations, handle nested JSON, and collaborate with data science teams to deliver production data platforms.

Design, build, and maintain scalable ETL/ELT pipelines ingesting travel-related data from multiple sources. Integrate and model data in cloud warehouses (Snowflake/BigQuery/Redshift), implement data quality and monitoring, support real-time streaming, and ensure data governance and regulatory compliance. Collaborate with analysts, data scientists, and product teams to deliver reliable datasets for personalization, forecasting, and optimization.

Build and maintain scalable cloud data pipelines and governance to support analytics across claims, EHR, and real-time patient data. Deploy and operate Snowflake/dbt/AWS-based infrastructure, enable real-time analytics, partner with clinical, product, and engineering teams, and deliver insights that inform care delivery, payer collaboration, and business decisions.

The Data Engineer will build and maintain scalable data pipelines, improve ETL processes, collaborate with AI/ML teams, and contribute to engineering culture.

The Data Engineer at Anteriad will design, build, and optimize data pipelines, manage data integration processes, support analytics efforts, and collaborate with stakeholders to deliver scalable data solutions.

Designs and maintains scalable data pipelines and platforms, develops ETL/ELT processes, and migrates heterogeneous external data into standardized enterprise models. The role includes data ingestion, transformation, quality validation, reconciliation, and billing-data standardization across systems. It collaborates with engineering, product, DevOps, and DBA teams, contributes to technical decisions, mentors engineers, and applies AI-assisted development tools. The position is based in Richmond, Virginia, with four days in office and one day remote.

As a Data Engineer, you will build and optimize data pipelines, ensuring accurate data delivery that informs pricing and market analytics at Alt.

Lead the design, development, and optimization of scalable batch and real-time data pipelines and platforms. Build cloud-based data solutions using distributed processing, streaming technologies, and modern data warehouses. Define data models, improve performance and reliability, establish engineering best practices, and provide technical guidance to data engineers while collaborating with architects, product teams, developers, and stakeholders.

Build and maintain data pipelines, applications, workflows, and governance in Palantir Foundry. Apply industrial engineering and operations research methods to analyze depot/MRO capacity, throughput, and bottlenecks, integrate ERP/MRO data into simulation models, deliver decision-support briefings, and support platform monitoring, automations, and client engagement.

Design, build, and operate scalable PostgreSQL databases and cloud-native data infrastructure. Build and maintain ETL/ELT pipelines, optimize query and server performance, ensure high availability and disaster recovery, improve observability, troubleshoot production issues, guide schema and application design, evaluate database technologies, and mentor junior engineers to support reliable, secure data-driven applications.

Lead pre-sales data engineering engagements to design and implement scalable lakehouse data platforms (Snowflake/Databricks). Advise customers on data strategy, governance, pipelines, AI-ready foundations, migrations, and translate technical solutions into business outcomes while supporting sales and partner enablement.

Design, build, and maintain ingestion and transformation pipelines for a knowledge-graph analytics platform. Profile and prepare structured and semi-structured source data, ensure data lineage and traceability, implement transformation logic for graph loading, collaborate with data scientists on graph modeling and entity resolution, improve pipeline reliability, and document ingestion patterns using version control and issue tracking.

Design, build, and maintain AWS-based data pipelines and ETL processes using Glue, Spark/PySpark and EMR. Integrate multiple data sources into data lakes and Redshift, implement DevOps CI/CD practices, and work with Kafka, Hudi, and various AWS storage and analytics services.

Design, build, and maintain Scala-based ETL and streaming data pipelines, APIs, and data microservices in Azure. Optimize LLM fine-tuning and RAG workflows, support DevOps/CI-CD practices, document standards, mentor engineers, and manage data ingestion frameworks for analytics and partner integrations.

The job involves leveraging AWS and Snowflake for data engineering tasks within a technology-focused company, requiring US residency.