Top Data Engineer Jobs in Charleston, SC

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Build and operate production data pipelines and dimensional models using Spark, SparkSQL, and cloud lakehouse technologies. Own pipelines from requirements through deployment, monitoring, and iteration; improve data quality, lineage, reliability, and cost efficiency. Partner with data scientists, analysts, product managers, and engineers to support datamarts, KPIs, reporting, and analysis. Participate in business-hours on-call rotations and improve runbooks and alerting.

Administer and enhance Edmunds’ Databricks data platform and AWS infrastructure. Build and maintain ETL pipelines, infrastructure-as-code tooling using Terraform or CDK, and operational dashboards, alerts, and reports. Collaborate with business, engineering, analytics, security, and infrastructure teams to support data platform users and AI solutions. Evaluate new technologies, troubleshoot platform issues, and improve operational, cost, and security visibility.

Define and govern enterprise-scale data architecture across batch, streaming, warehouse, lakehouse, transactional, and AI use cases. Establish standards for data quality, lineage, access, cataloging, governance, observability, and SLAs. Architect AI-enabled workflows, resolve complex architecture issues, influence roadmaps, and mentor engineers through hands-on technical leadership. The role requires 15+ years of software, data engineering, or architecture experience and expertise in large-scale data platforms and modeling.

Manage Microsoft Fabric dataflows, pipelines, APIs, external integrations, error reporting, and Azure capacity. Build and maintain scalable data warehouse infrastructure, optimize data access, and support AI and machine learning workloads. Document processes and operational best practices while collaborating with data engineers, BI analysts, and AI specialists.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Designs and maintains data warehouse infrastructure, semantic and dimensional models, metrics layers, dashboards, reporting, and secure data pipelines. Builds governed self-service analytics in Sigma, Power BI, and Databricks; defines KPIs and data standards; implements row-level security and Entra ID controls; supports data quality, observability, AI/ML use cases, and BI adoption. Collaborates with technical and business stakeholders in an Agile-Scrum environment.

Build and maintain production data ingestion pipelines, transformation models, warehouses, and schemas for PerfectServe’s data platform. Deploy reliable, tested pipelines using idempotency and data-quality checks, apply dimensional and medallion modeling, participate in design reviews, and document owned pipelines and runbooks. The role requires SQL, programming experience, dbt or similar transformation tools, cloud data warehouse experience, ELT orchestration, AWS knowledge, and a strong data-testing mindset.

Designs, builds, and maintains enterprise data pipelines, ETL processes, integrations, data infrastructure, and complex data models. The role supports analytics partners, develops scalable data warehouse solutions, tunes SQL and databases, troubleshoots production issues, and collaborates with architects, analysts, developers, and stakeholders. Responsibilities include end-to-end project delivery, data modeling, big data engineering, production support, agile planning, and mentoring team members.

Own end-to-end data workflows, including ingestion, storage, orchestration, transformation, validation, and delivery. Build ETL/ELT pipelines, manage cloud data platforms and transfers, optimize data models and queries, maintain data quality monitoring, troubleshoot production issues, and document data flows. Collaborate with technical and nontechnical teams to investigate discrepancies, support enterprise datasets, and apply secure data-handling practices.

Build and maintain production ETL/ELT pipelines, data models, and curated datasets for analytics and AI applications. Ingest data from databases, APIs, SaaS tools, and event streams; implement quality checks, monitoring, documentation, governance, and access controls. Collaborate with analysts, data scientists, and ML engineers on reporting, feature datasets, AI search, and RAG applications. Optimize query performance and pipeline costs while using Git, code reviews, and CI/CD for safe releases.

Build and operate event-driven data pipelines processing healthcare claims data for fraud, waste, and abuse detection. Operationalize validated fraud signals, maintain alert delivery and partner dashboards, monitor pipeline reliability, and collaborate with data architects, scientists, and investigative teams. The role requires production-scale pipeline engineering using AWS, Snowflake, Python, and SQL in a fully remote environment.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Build and maintain production data pipelines and foundational datasets for Market Intelligence. Automate survey ingestion, cleaning, joining, scheduling, monitoring, and reporting-layer integration. Develop repeatable queries, improve data quality practices, document assumptions, support reproducible outputs, and translate research needs into technical solutions. The role requires close collaboration with technical and nontechnical stakeholders and ownership of reliable data infrastructure.

Build and operate platform infrastructure for product analytics, data processing, and ML systems. Responsibilities include event tracking pipelines, Databricks Bronze-to-Gold lakehouse layers, schema evolution, data contracts, CI validation, backfills, monitoring, feature computation, model pipelines, lineage, PHI policy enforcement, and self-service developer tooling. The role focuses on making data and ML changes safe, observable, reproducible, and accessible to engineers and subject-matter experts.

Design, build, and scale data pipelines, ETL workflows, analytics infrastructure, and machine-learning data systems. Ensure data quality, security, monitoring, and reliability while optimizing storage and processing performance. Collaborate with engineering, product, and analytics teams on data requirements, modeling, schemas, and scalable infrastructure. The role also establishes data engineering best practices and supports a data-driven culture.

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.

Design, build, and maintain scalable data pipelines, data lakes, and databases; ingest and map customer financial datasets; monitor pipeline reliability; translate business requirements into data flows and analytical insights to ensure high-quality, usable data.

Designs and builds cloud-based, data-centric applications supporting clinical and operational healthcare processes. Develops data pipelines, transformations, enrichment processes, provisioning layers, and user interfaces. Collaborates with Product, Platform, and Architecture teams using modern software development practices, source control, documentation, and regular delivery methods.

Designs, builds, tests, deploys, and maintains secure ETL/ELT pipelines for public health data. Integrates Power Platform, Azure services, APIs, SQL Server, CDC/NIOSH systems, and approved file-transfer platforms. Develops batch, event-driven, and near-real-time data workflows supporting intake, validation, reporting, analytics, notifications, and results delivery while meeting FISMA Moderate, federal privacy, Agile, and DevSecOps requirements.

Lead the design and development of Azure-based big data solutions, including batch and real-time ETL/ELT pipelines, data architecture, ingestion, curation, warehousing, and storage. Build solutions using Azure Data Factory, Databricks, Synapse, Spark, Python, SQL, and related Azure services. Support Salesforce migration and integration while applying strong RDBMS, data management, and big data design expertise.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Lead the architecture and development of Vercel’s next-generation data platform, supporting batch and real-time integrations, analytics, data warehousing, and AI/ML workloads. Design scalable systems using Kafka, ClickHouse, Tinybird, and Snowflake; establish data governance and security standards; guide architectural decisions and roadmaps; collaborate with engineering, product, security, compliance, and leadership teams; write production code; and mentor engineers.

Build and maintain scalable ETL/ELT pipelines, integrate travel and customer data from internal and external systems, develop cloud data warehouse models, implement data quality monitoring, support real-time streaming, and ensure data privacy and regulatory compliance. Collaborate with analysts, data scientists, and product teams to deliver reliable datasets for personalization, forecasting, pricing, route optimization, and customer experience initiatives.

Build and maintain Google Cloud data pipelines and ETL/ELT processes supporting GenAI and RAG solutions. Classify and govern sensitive data using Dataplex and Cloud DLP, enforce access controls, assess AI readiness, and design reusable schemas and data models. Collaborate with engineering, delivery, and client teams to integrate legacy systems, monitor pipeline reliability, conduct data quality testing, document data flows, and proactively identify compliance and delivery risks.