Top Data Engineer Jobs in Raleigh, NC

Design, build, and maintain scalable batch and streaming data pipelines on Databricks using PySpark, Delta Lake, Unity Catalog, and cloud platforms. Troubleshoot performance and quality issues, implement data governance, collaborate with cross-functional teams, and document pipelines and data models to deliver reliable, production-ready data products.

Build and support high-performance data solutions, design and operate ETL pipelines and data warehouses, monitor production analytics tools, troubleshoot system issues, collaborate with product teams, and support TechOps for analytics infrastructure.

We are seeking a Data Engineer to design, build and optimize scalable data pipelines. Strong experience in Databricks, PySpark, and data warehouse concepts is required.

Design, develop, test, maintain, and support secure, scalable data solutions using Snowflake and Databricks. Lead technical design, author specifications, review code, mentor engineers, ensure SDLC, audit/security compliance, and drive technical strategy while collaborating with architects and business partners. Participate in Agile ceremonies, be on-call as needed, and travel occasionally.

Build and maintain production-grade data processing systems and foundational infrastructure for enterprise AI. Collaborate with researchers and engineers, deliver end-to-end implementations, transform unstructured data into performant datasets, and use distributed processing frameworks and modern analytics tooling to inform products and strategy.

Lead design, build, and operate real-time, Flink-based streaming data platforms. Develop low-latency, stateful pipelines, enforce event schemas/contracts, ensure fault tolerance and observability, mentor engineers, and partner with architecture and compliance teams to deliver resilient streaming solutions for banking use cases.

The Principal Data Engineer will lead data architecture initiatives, design scalable data systems, and oversee data standards across teams while ensuring high-quality data infrastructure and guiding engineering teams.

Design, build, and maintain an internal data platform and pipelines. Ensure secure, governed, resilient data access for engineering and BI teams. Partner with architects, implement automations, support platform consumption, mentor users, and drive continuous improvement and compliance.

Build, maintain, and monitor ETL/ELT pipelines in the Microsoft Fabric ecosystem. Implement medallion architecture, transform raw data into analytics-ready models, ensure pipeline reliability and data quality, troubleshoot failures, optimize performance, and support CI/CD and version control for data artifacts.

Own product telemetry, maintain dbt models in Snowflake, support self-service reporting and NLP queries, drive product insights from user and retention data, and monitor Airbyte syncs to ensure data quality.

Build and operate ingestion and transformation pipelines to turn messy insurance data into clean datasets. Design bronze/silver/fact layers, model and tune Postgres and analytical stores, define KPIs and reconciliation checks, orchestrate observable data jobs, and ensure end-to-end data quality for analytics and AI products.

Build and maintain data marts, materialized views, and ETL/ELT pipelines in an AWS-hosted data lake. Design and optimize data workflows, monitor infrastructure health and data quality, support PostgreSQL migrations, collaborate with cross-functional teams, and ensure compliance with federal data security (FISMA/NIST 800-53).

Lead architecture, systems, and roadmap for Coinbase's Compliance Reporting Data Platform. Design and build production-grade data models, pipelines, quality frameworks, validations, and certification processes. Establish data contracts, monitoring, reconciliation, and audit-ready processes. Partner with engineering and compliance stakeholders, respond to regulatory exams, and mentor engineers while shaping standards and documentation.

As a Data Engineer, you will build and maintain data pipelines, convert data into metrics, and operate the platform on AWS. Responsibilities include writing production code, processing data from APIs, and enhancing the orchestration layer using Dagster, while ensuring compliance in a HIPAA-regulated environment.

As a Data Engineer, you will build and maintain data pipelines, ensure data quality, support ML workflows, and optimize query performance using various technologies.

The Data Engineer is responsible for designing data workflows and pipelines, implementing systems engineering principles, and deploying data streaming technologies while ensuring compliance with industry regulations and best practices.

Forward-deployed senior data engineer who deploys, hardens, integrates, and operates a data platform (lakehouse, streaming, governance) in DoD environments. Build pipelines across classification boundaries, produce accreditation evidence (STIG/cATO/FIPS), run day-2 operations, train mission teams, and mentor junior FDEs while feeding field feedback into product improvements.

The Data Engineer I at Storable supports the design and maintenance of data pipelines, works with ETL processes, optimizes workflows, and collaborates with various teams to enhance data accessibility and reliability.

Design, build, and maintain scalable batch and near-real-time data pipelines and data products using Databricks and Spark. Integrate internal/external sources, implement data models, ensure data quality, support BI (Sisense), CI/CD, and collaborate with analysts, scientists, and stakeholders to enable analytics and decision-making.

Design, build, and maintain scalable ETL and data pipelines on AWS using Python/PySpark. Develop Glue/Lambda/Step Function workflows, event-driven integrations, and data lake/warehouse solutions. Tune SQL, implement monitoring/validation, support API/JSON integrations, troubleshoot operations, document and automate deployments, and mentor junior engineers.

Support building and maintaining ETL pipelines using Python and PySpark. Work with AWS services (Glue, Lambda, Step Functions, S3, Redshift, RDS, EMR) to ingest, transform, and validate data. Write complex SQL, implement basic monitoring/logging, process API/JSON payloads, and collaborate with engineers, analysts, and stakeholders on deployment and documentation.

Design and implement scalable data pipelines and orchestration on GCP to support AI/ML-driven mail intelligence. Build stream and batch processing, ensure data governance and quality, optimize workflows, create visualizations, and collaborate with US cross-functional teams to align technical strategy and recover from failures.

Design, develop, maintain, and optimize ADABAS database structures and data solutions. Support mainframe data processing (Natural, COBOL, JCL), perform migrations to modern platforms, tune performance, ensure data integrity/security, troubleshoot issues, and collaborate with developers, architects, and analysts on modernization, API/cloud integration, and data warehousing initiatives.

Design, build, and maintain Data Vault 2.0 data warehouse and Power BI solutions. Develop ETL pipelines, data models, reusable datasets, and data governance. Perform profiling, cleansing, migrations, and collaborate with infrastructure teams to optimize data delivery, automation, and reporting.

Owner of data platform modernization: design and migrate legacy systems to Kimball-style dimensional models and star schemas; build reliable production data pipelines; enforce data hygiene and validation; champion dbt best practices; mentor junior engineers; collaborate with analysts and stakeholders to ensure scalable, well-documented data models and platform observability.