Top Data Engineer Jobs in Charleston, SC

Design, build, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, SQL, Spark, and Delta Lake. Develop transformations, orchestration workflows, data models, validation processes, and curated data products. Troubleshoot performance and quality issues, apply governance and security practices, document solutions, and collaborate with architects, data scientists, DevOps teams, analysts, and clients.

Build and maintain FinOps data pipelines, BigQuery and dbt models, cost attribution systems, forecasting and anomaly detection models, and cost-versus-revenue analytics. Identify and implement AWS and GCP savings opportunities, automate governance with Python, Terraform, and Lambda, and partner with Engineering, Finance, Product, and leadership on cloud costs, forecasting, reporting, and architecture decisions.

Designs, develops, maintains, and improves software applications and business processes. Responsibilities include full lifecycle development, troubleshooting, performance and reliability improvements, CI/CD collaboration, requirements analysis, technology research, package maintenance, portfolio planning, and mentoring junior engineers. The role requires independent work, cross-functional collaboration, and strong software development, documentation, and problem-solving skills.

Designs, develops, maintains, and optimizes complex data systems, SQL/ETL processes, reporting solutions, and .NET applications supporting pharmacy benefit management. Responsibilities include database performance tuning, data warehousing, troubleshooting pharmacy claims, technical specification development, software testing, cloud integration, stakeholder collaboration, Agile participation, and mentoring. The role requires strong SQL Server, dimensional modeling, cloud database, Python, PowerShell, and healthcare data standards expertise.

Designs and optimizes scalable data platforms, architectures, and production pipelines supporting AI and machine learning. Responsibilities include Databricks Lakehouse development, batch and real-time processing, data governance, security, monitoring, performance tuning, infrastructure planning, and collaboration with DevOps, MLOps, and cross-functional teams. The role serves as the AI team’s data engineering subject matter expert and ensures reliable, secure, cost-effective data solutions.

Build governed, reusable Data 360 products and scalable transformation pipelines using SQL, Python, dbt, and Snowflake. Establish dimensional models, semantic layers, trusted metrics, data quality controls, lineage, and governance for clinical, laboratory, operational, and commercial data. Ensure PHI and genomic data compliance while integrating AI-native engineering practices. Collaborate with cross-functional stakeholders, lead architecture decisions, validate data products, resolve complex data issues, and mentor engineers.

Build, operate, and improve Tala’s production data synchronization and change data capture pipelines across global markets. Deliver reliable, low-latency data to Snowflake using AWS, Kafka, Spark Structured Streaming, and lakehouse technologies. Improve scalability, performance, cost efficiency, data quality, monitoring, testing, CI/CD, and infrastructure as code. Troubleshoot incidents, lead root-cause analyses, document operational practices, contribute to architecture decisions, and collaborate with data, analytics, product, credit, and business teams.

Designs, builds, and optimizes enterprise data pipelines, warehouses, lakes, semantic models, and ETL/ELT solutions. Develops SQL and Power BI solutions, leads data modeling, ensures data quality and governance, resolves performance issues, and contributes to data architecture. Collaborates with HR stakeholders, analysts, data scientists, and technology teams to deliver scalable analytics and reporting platforms.

Develop and maintain data pipelines, infrastructure, and integrations supporting analytics, data science, and business intelligence. Ensure data quality and integrity, optimize workflows, and collaborate with Operations, IT, Accounting, HR, Property Services, Marketing, and other departments. The role requires SQL Server, programming, shell scripting, cloud, containerization, version control, and data pipeline knowledge, with occasional travel and flexible scheduling as project deadlines require.

Leads the design, development, and optimization of scalable data pipelines and analytics platforms. Builds ETL/ELT workflows using Databricks and Spark, integrates and transforms source data into curated models, manages SQL Server data, and maintains documentation and lineage. Collaborates with product, analytics, and engineering teams to deliver reliable data solutions. Applies responsible AI practices and delivers projects independently within established timelines.

Designs, develops, tests, and supports scalable investment data platforms, pipelines, APIs, and data-transfer services. Responsibilities include data ingestion, validation, integration, storage, delivery, performance optimization, CI/CD, documentation, security, troubleshooting, and collaboration with business and technology stakeholders. The role supports research, portfolio management, trading, analytics, and reporting functions.

Design, build, and optimize enterprise ETL/ELT pipelines, cloud data lakes, lakehouse solutions, data models, and semantic layers across AWS and Azure. Ensure data quality, security, performance, reliability, and governance while supporting analytics, reporting, and AI initiatives. Collaborate with product, engineering, IT, and business stakeholders to translate requirements into scalable data solutions, monitor pipeline health, troubleshoot issues, and improve data architecture and practices.

Own Step’s analytics data models, transformation pipelines, metric definitions, semantic layer, and data quality practices. Partner with Product, Marketing, Engineering, Risk, Growth, and Finance to establish trustworthy data foundations and enable self-service analysis. Build reusable query, visualization, and code components; apply AI-augmented workflows; and collaborate with data scientists, analysts, and platform engineers. The role requires strong SQL, modeling, pipeline, BI, communication, and independent ownership skills, with occasional travel for team onsites.

Design, build, and operate end-to-end data pipelines and models for healthcare claims and payer data. Responsibilities include ingestion, canonical and analytical data modeling, legacy process migration, data quality, testing, CI/CD, deployment, operations, incident response, tool integration, documentation, and onboarding new data sources. The role partners across ML, product, analytics, platform, operations, and customer teams while critically evaluating AI-generated engineering work.

Own Mux’s end-to-end data platform, including ingestion, Snowflake administration, dbt transformations, orchestration, data quality, observability, and reverse ETL. Build semantic models supporting AI agents, establish governance and reliability standards, and partner with Engineering, Finance, Product, and GTM. Use AI coding tools to develop and maintain pipelines while validating output quality. The role requires strong SQL, Python, data modeling, cloud warehouse administration, and production data engineering experience.

Designs, builds, and optimizes scalable Databricks-based data platforms, pipelines, integrations, and reusable engineering tools. The role focuses on platform performance, reliability, cost efficiency, security, governance, automation, and cloud infrastructure. It collaborates with engineering, analytics, security, and other stakeholders on architecture, technical planning, production support, and continuous improvement. The position requires hands-on data engineering experience with Databricks, cloud services, Python, SQL, Spark, infrastructure-as-code, and CI/CD practices.

Build and operate a governed Snowflake enterprise data warehouse, including ingestion, orchestration, dbt transformations, infrastructure as code, security controls, reliability checks, and CI/CD. Partner with data owners and BI teams during migration from legacy systems, ensure compliance for sensitive financial data, support reconciliation and incident resolution, and mentor engineers. The role requires hands-on ownership of pipelines and platform components across development and production environments.

Lead the architecture and development of Penn Foster Group’s Databricks-based cloud data platform. Build scalable batch, streaming, CDC, and API pipelines using Python, SQL, Spark, and Azure; establish engineering standards, governance, observability, and CI/CD practices; develop AI-ready semantic data products; and mentor data engineers. Partner with BI, product, security, governance, and MLOps teams to support analytics, machine learning, generative AI, and self-service reporting.

Own end-to-end client data migrations: reverse-engineer legacy ETL, design and build Airflow DAGs and Spark jobs, validate and reconcile data at scale, document architecture and decisions, and coordinate cross-functional teams through go-live and hypercare.

Lead production of marine and anadromous species range maps under FWS standards. Aggregate, normalize, transform, and validate spatial data; analyze habitat intersections; coordinate review cycles with FWS and NOAA Fisheries subject matter experts; document quality assurance; and obtain government sign-off for deliverables.

Designs and leads enterprise data pipelines and integrations across Snowflake, Oracle Fusion, on-premises databases, and cloud applications. Ensures data quality, governance, security, scalability, and performance while supporting Power BI, AI/ML, and self-service analytics. Partners with business and technical stakeholders, leads migrations, mentors engineers, optimizes data platforms, and establishes engineering best practices.

Designs, builds, deploys, and maintains scalable data pipelines, data lake systems, batch and streaming processing, MLOps frameworks, data documentation tooling, and an agentic data exploration platform. The role supports customer-facing products and enables engineering teams through reliable infrastructure, observability, data discovery, and AI capabilities.

Build and operate scalable batch and streaming data pipelines, data lake infrastructure, MLOps frameworks, data documentation systems, and an AI-assisted data exploration tool. The role focuses on reliable data ingestion, large-scale processing, workflow orchestration, observability, and infrastructure supporting customer-facing products and machine learning development.

Build and maintain production data ingestion, transformation, and pipeline systems for a governed federal data and AI platform. Develop data products, infrastructure-as-code, CI/CD workflows, monitoring, quality controls, cataloging, and access controls within FedRAMP, NIST 800-171, and CUI constraints. Support data science and machine learning teams, troubleshoot reliability and performance issues, and document engineering processes. The role is fully remote and requires U.S. citizenship and the ability to obtain a T5/SSBI adjudicated clearance.

Build and maintain production data pipelines that transform robot logs and telemetry into reliable, queryable datasets. Design Spark-based ETL workflows, orchestrate processing with Airflow or similar tools, manage gold-layer datasets, and implement data quality, schema evolution, monitoring, and metadata practices. Collaborate with robotics, hardware, reliability, analytics, and ML teams on data modeling, fleet insights, debugging, and root-cause analysis. The role may also contribute to Python, Java, or C++ libraries supporting data capture and consumption.