Top Senior Data Engineer Jobs in Charleston, SC

The Data Engineer will design and build scalable data pipelines, optimize data infrastructure, and collaborate with teams for data solutions in an eCommerce environment.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

As a Senior Data Engineer, you will design and maintain scalable data models, build production data pipelines, and support analytics across various business functions.

Lead end-to-end data engineering on GCP: design scalable data platforms and architectures (lake/lakehouse/warehouse), build and optimize BigQuery/Spark pipelines, ensure data quality/security, enable ML workflows with Data Science, mentor engineers, and own delivery and performance.

Design, build, and optimize scalable AWS-based data pipelines, data lakes, and warehouses. Migrate legacy systems, enforce data quality/security/governance, implement ETL/ELT and big-data solutions, adopt CI/CD and IaC, collaborate with stakeholders, and provide technical leadership and troubleshooting.

Lead architecture and delivery of a cloud-native, petabyte-scale data platform: define technical roadmap, mentor engineers, build ETL/ELT pipelines, enable real-time streaming, implement Iceberg table format, optimize Snowflake/Redshift/Athena compute, and integrate observability with Splunk.

Design, build, and maintain scalable data pipelines on AWS using EMR, Spark, and PySpark. Optimize EMR clusters and Spark jobs, implement ETL/ELT processes, ensure data quality, automate ingestion, and collaborate with data scientists and analysts. Document infrastructure, participate in code reviews, and monitor performance and costs.

Design, build, and maintain ETL/ELT data pipelines and orchestration using Airflow, Python, and PySpark. Develop custom connectors, implement DataOps and CI/CD for data workflows, monitor and troubleshoot pipelines, validate data quality, and document processes while collaborating with cross-functional teams and supporting large-scale distributed data systems.

Design, build, modernize, and maintain operational and analytical data capabilities for Wealthscape Reporting, Analytics and Insights. Perform solution design, data analysis, ETL development, and production rollouts using Snowflake, AWS, cloud databases, and CI/CD pipelines. Collaborate across teams in a fast-paced financial services environment.

Design, build, and maintain scalable data pipelines, lakes, and infrastructure using Databricks, Spark, Python, and AWS. Collaborate with ML engineers, data scientists, and analysts to deliver data products, ensure data quality and governance, implement DevOps/SDLC practices, mentor junior engineers, and evaluate new data technologies.

Design and maintain executive Power BI dashboards and Power Apps, translate clinical and financial data into actionable insights, build frontend data products, educate end-users, partner with backend engineers to build pipelines in Microsoft Fabric, and perform ad-hoc healthcare analytics and modeling to support operational leaders.

Lead design, build, and operate real-time, Flink-based streaming data platforms. Develop low-latency, stateful pipelines, enforce event schemas/contracts, ensure fault tolerance and observability, mentor engineers, and partner with architecture and compliance teams to deliver resilient streaming solutions for banking use cases.

The Manufacturing Analytics Engineer will manage the analytics pipeline, transforming operational data from OT systems into actionable insights for decision-making, while collaborating with Engineering, IT, and Operations.

Lead graph data engineering to design, implement, and scale Neo4j-based graph platforms. Build graph models, ingestion pipelines (batch and streaming), integrate graphs with analytics/ML, establish governance, and enable graph-driven business use cases like fraud detection and Customer 360.

Lead architecture and implementation of a large-scale analytics stack: design foundational pipelines, establish modeling/orchestration standards, integrate AI-assisted engineering tools, translate business questions into version-controlled data models, partner with stakeholders to define metrics and data contracts, migrate logic into maintainable pipelines, and optimize cloud warehouse performance for scale.

Design, build, and optimize Snowflake-based data warehouses and dbt transformation pipelines. Develop scalable ETL/ELT ingestion, tune SQL and warehouse performance, implement data quality/testing (dbt tests), and maintain CI/CD and version-controlled data workflows while collaborating with analysts, data scientists, and stakeholders.

The Data Engineer III will lead the development and maintenance of data infrastructure and tools, ensuring data integrity while driving strategic data initiatives.

Lead the design and operation of Twilio's ML and data platform, architecting cloud-native pipelines and implementing MLOps best practices while mentoring engineers and collaborating across teams.

The Data Engineer will design and maintain data pipelines, enhance the data warehouse, support machine learning applications, and collaborate with various teams to leverage data effectively.

As a Senior Forward Deployed Data Engineer, you will design and implement data pipelines for media agency clients, manage technical delivery, and ensure data security while mentoring junior engineers and communicating effectively with stakeholders.

As a Data Engineer, you will design and maintain data pipelines, support DoD systems, and ensure data quality and compliance.

The Data Engineer is responsible for designing data workflows and pipelines, implementing systems engineering principles, and deploying data streaming technologies while ensuring compliance with industry regulations and best practices.

Forward-deployed senior data engineer who deploys, hardens, integrates, and operates a data platform (lakehouse, streaming, governance) in DoD environments. Build pipelines across classification boundaries, produce accreditation evidence (STIG/cATO/FIPS), run day-2 operations, train mission teams, and mentor junior FDEs while feeding field feedback into product improvements.