Top Data Engineer Jobs in Charleston, SC

Designs and leads production-grade batch, incremental, streaming, and real-time data pipelines across Microsoft Fabric and Azure. Builds Delta Lake medallion architectures, dimensional and Data Vault models, CDC and incremental-loading solutions, CI/CD automation, governance, security, observability, and data-quality controls. Supports migrations to Fabric, prepares governed data for AI and RAG workloads, and leads client-facing engineering workstreams, estimates, risk management, mentoring, and operational handover.

Own PushPress’s data platform, including ingestion, orchestration, cloud warehouse performance, governance, privacy, data quality, monitoring, and AI-ready data foundations. Build reliable pipelines integrating product, payment, and third-party data; establish data contracts, access controls, auditability, and semantic definitions; support real-time analytics and trustworthy reporting. Partner with Engineering, Data, and AI teams while maintaining infrastructure, incident response, documentation, and operational runbooks.

Build and own production data infrastructure for a healthcare AI platform. Responsibilities include REST API ingestion, Azure Event Hubs streaming into Databricks, Delta Lake medallion pipelines, entity resolution, semantic metrics, data-quality instrumentation, reconciliation, schema-drift handling, and troubleshooting source-to-warehouse discrepancies. The role requires strong Python and SQL skills, independent pipeline ownership, and experience with Databricks, Spark, PySpark, streaming, and healthcare-related data is a plus.

Administer and enhance Edmunds’ Databricks data platform and AWS infrastructure. Build and maintain ETL pipelines, infrastructure-as-code tooling using Terraform or CDK, and operational dashboards, alerts, and reports. Collaborate with business, engineering, analytics, security, and infrastructure teams to support data platform users and AI solutions. Evaluate new technologies, troubleshoot platform issues, and improve operational, cost, and security visibility.

Build and guide data platform capabilities supporting marketing, finance, analytics, and data science. Develop data collection, integration, scoring, experimentation, analytics, and infrastructure solutions; contribute code, lead cross-functional technical initiatives, improve system resiliency through incident response, and establish engineering standards. Partner with business and technical stakeholders to define strategy and long-term roadmaps.

Builds business-critical dashboards, scorecards, reports, and ad hoc analyses using SQL, Python, Excel, Power BI, and Tableau. Analyzes KPIs, identifies trends and root causes, automates recurring reporting, validates data, and translates complex findings into actionable insights for stakeholders and leadership. The role collaborates with data engineers and cross-functional teams to improve reporting workflows, data pipelines, and decision-making.

Lead financial data engineering initiatives involving commissions, incentive programs, and backend financial systems. Build scalable, accurate, and reliable data pipelines, platform tooling, partner integrations, analytics infrastructure, and data science infrastructure. Shape technical strategy and roadmaps, collaborate with Finance, Product, Data Science, and Engineering, mentor engineers, contribute code, lead incident response, and establish engineering standards.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Designs, develops, and maintains scalable cloud-based data pipelines and enterprise data solutions. The role covers data ingestion, transformation, orchestration, integration, data lakes, cloud warehouses, batch and streaming processes, performance optimization, governance, and lineage. The Senior Data Engineer collaborates with analysts, data scientists, engineers, stakeholders, contractors, and vendors while mentoring junior staff. Core tools include Databricks, dbt, Azure Data Factory, SQL, Python, and Azure.

Own the architecture and operation of 9amHealth’s data platform, including Python and SQL ETL/ELT pipelines, AWS infrastructure, Redshift data models, semantic layers, governance, quality, monitoring, and reliability. Establish technical standards, optimize performance and costs, support AI/ML initiatives, build integrations, and mentor data team members. Partner with business and clinical stakeholders to deliver reliable data products and translate complex questions into actionable analytics.

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.

Build and scale secure data lakehouse and warehouse infrastructure supporting analytics, machine learning, clinical AI performance monitoring, and self-service insights. Develop scalable data pipelines, models, orchestration, quality controls, and LLM-enabled analytics tools using heterogeneous clinical and EHR data. Collaborate with engineering, data science, clinical, product, and client success teams to establish trustworthy metrics and technical solutions.

Lead pre-sales technical engagements to design and optimize scalable cloud lakehouse data platforms (Snowflake/Databricks). Provide architecture reviews, ETL/ELT pipeline design, governance and AI-ready data foundations, support services sales, and translate technical tradeoffs into actionable recommendations for engineering and executive stakeholders.

Design, build, and operate production data pipelines using Python, Spark SQL, and Airflow. Canonicalize healthcare and customer data into trusted internal models, optimize distributed processing, enforce schemas, and implement quality checks and observability. Support customer onboarding, streaming pipelines, troubleshooting, on-call operations, and platform best practices while collaborating with product, analytics, engineering, data science, and customer teams.

Own the analytics data layer by translating stakeholder needs into certified dimensional models, governed metrics, semantic layers, dashboards, and reports. Build with dbt, SQL, Databricks, Power BI, and Airflow while ensuring data quality, observability, reconciliation, documentation, and dependable orchestration. Partner closely with finance, operations, and client-facing teams, automate recurring workflows, and use AI-assisted engineering practices in a fully remote environment.

Own the technical design and operation of Palmetto’s governed data platform. Build trusted data products, semantic models, ingestion and transformation pipelines, secure access interfaces, and agent-ready data services. Establish governance, masking, authorization, observability, CI/CD, and audit readiness. Partner with finance, operations, product, and engineering teams while mentoring engineers and setting cross-team technical direction.

Build scalable data ingestion, transformation, and loading infrastructure using Spark, SQL, AWS, and Databricks. Develop entity resolution systems, CI/CD pipelines, anomaly detection, and high-quality data products. Design scalable processing and storage patterns, orchestration workflows, and data warehousing solutions while collaborating remotely and documenting technical designs.

Designs, develops, maintains, and optimizes complex data systems, SQL databases, ETL processes, data warehouses, reports, and .NET applications supporting pharmacy benefit management. Responsibilities include database performance tuning, troubleshooting pharmacy claims processes, developing scalable solutions, documenting technical designs, participating in Agile ceremonies, collaborating with stakeholders, mentoring teammates, and ensuring healthcare data compliance.

Lead architecture, development, and optimization of a cloud-native data platform. Design high-volume batch and streaming pipelines, optimize data processing across AWS, Snowflake, Redshift, and Athena, and implement Iceberg-based data management. Establish security, privacy, observability, and DataOps practices while mentoring engineers, guiding technical direction, collaborating with data science teams, and delivering scalable petabyte-level data infrastructure.

Design, build, and maintain scalable big data pipelines, architectures, distributed databases, and storage systems. Use Python and frameworks such as Hadoop, Spark, or Flink for data integration, transformation, and processing. Ensure system performance, availability, security, governance, and data quality while collaborating with cross-functional teams and documenting technical solutions.

Design, build, deploy, and maintain AWS-based data and AI/ML infrastructure for enterprise agentic AI platforms. Develop data lake pipelines, observability systems, agent-enablement tooling, and production MLOps/LLMOps capabilities. Own features end-to-end, contribute to architecture and design decisions, optimize reliability, scalability, security, and cost, and collaborate with AWS Professional Services, client teams, and junior engineers.

Provide senior-level data engineering for analytics: resolve complex technical issues, build decision-support reports and dashboards, lead projects, prepare and integrate data, coach staff, and ensure high-quality analytics to support academic, research, and healthcare goals.

Designs and productionizes hybrid knowledge graph solutions for healthcare and clinical data using LPG and RDF technologies. Builds FHIR transformation and ingestion pipelines, implements ontology mappings, entity linking, identifiers, provenance, validation, and graph queries with Cypher or SPARQL. Collaborates with ontology, terminology, FHIR, clinical, and data engineering teams, while contributing to architecture reviews, code reviews, testing, and engineering best practices.

Design, develop, and maintain Customer Data Platform solutions and data pipelines to create unified customer profiles, manage identity resolution, enable audience segmentation and activation, ensure data quality and governance, and support integrations with marketing, CRM, and cloud data systems.

Build customer-facing data products for the single-family rental market. Responsibilities include architecting real estate data models, designing reliable data pipelines and workflows, shaping data platform architecture, establishing engineering standards, and developing real estate domain expertise. The role partners with data science and product teams and requires leadership in scalable data engineering.