Senior Data Engineer

Posted 9 Days Ago
Be an Early Applicant
Johannesburg, City of Johannesburg, Gauteng, ZAF
In-Office
Senior level
Information Technology • Pet • Professional Services
The Role
Build and deliver a future-state cloud data platform MVP, including Snowflake data models, scalable pipelines, automated ingestion, dbt transformations, data quality controls, monitoring, CI/CD, DataOps, and Power BI reporting. Establish reusable engineering standards, security and governance practices, and support migration from legacy reporting. Collaborate with stakeholders, troubleshoot platform issues, and transfer knowledge to internal teams while handling sensitive healthcare data.
Summary Generated by Built In

We are seeking an experienced Senior Data Engineer to join a high-impact greenfield data platform initiative within the healthcare and medical scheme administration environment.

This is a highly technical, delivery-focused role responsible for building the future-state MVP and establishing the foundational architecture, engineering standards and reusable patterns required to support the long-term scalability and automation of the data platform.

The successful candidate will be comfortable working independently, translating business and analytics requirements into robust technical solutions, and operating within a POPIA-sensitive health-data environment.

Key Responsibilities
  • Design and build the future-state data platform MVP, including scalable data pipelines and transformation processes.
  • Develop and implement automated data ingestion and integration patterns.
  • Build robust and reusable Snowflake data models aligned to business and analytics requirements.
  • Develop transformation workflows using dbt, applying modern analytics engineering practices.
  • Implement data ingestion using Fivetran and establish reliable integration patterns.
  • Design and implement automated data quality checks, testing and validation frameworks.
  • Establish monitoring and controls to ensure data accuracy, reliability, availability and performance.
  • Apply CI/CD practices across data and analytics engineering workflows.
  • Implement and promote DataOps practices to improve automation, deployment, monitoring and operational reliability.
  • Support migration from legacy reporting processes to the target-state data architecture.
  • Establish reusable engineering standards, frameworks, patterns and documentation for future phases of the platform.
  • Develop and support the Power BI reporting layer required for the MVP.
  • Collaborate with business, analytics and technical stakeholders to translate requirements into scalable technical solutions.
  • Ensure solutions are designed with appropriate security, governance, metadata management and POPIA considerations.
  • Provide technical guidance and knowledge transfer to Medscheme staff, supporting the sustainable adoption of the new platform.
  • Troubleshoot technical issues and continuously improve the performance, scalability and reliability of the data platform.


RequirementsRequired Technical Skills

The successful candidate must have strong, hands-on experience with the following technologies and disciplines:

  • Snowflake
  • dbt
  • AWS
  • Fivetran
  • Power BI
  • Advanced SQL
  • Data modelling
  • Modern data engineering
  • Automated data quality and testing
  • CI/CD for analytics engineering
  • DataOps
  • Metadata management
  • Data integration and pipeline development

Important: Candidates should have direct, practical experience across the required modern cloud data engineering stack. Adjacent or theoretical exposure will not be sufficient.

Candidate Profile

We are looking for a self-sufficient Senior Data Engineer who can take ownership of the technical build and deliver outcomes with minimal supervision.

The ideal candidate will:

  • Have strong senior-level experience in modern cloud data engineering.
  • Be highly proficient across the Snowflake, dbt, AWS and Fivetran technology stack.
  • Have experience designing and implementing scalable data platforms and pipelines.
  • Understand modern DataOps, CI/CD and automated data quality practices.
  • Be capable of developing reusable frameworks and engineering standards rather than one-off solutions.
  • Be comfortable translating business and analytics requirements into technical solutions.
  • Have strong data modelling and SQL capabilities.
  • Be able to work independently in a delivery-focused environment.
  • Have strong problem-solving and analytical capabilities.
  • Be comfortable working with sensitive and regulated data.
  • Understand the importance of data governance, security, quality and metadata management.
  • Be able to communicate effectively with both technical and non-technical stakeholders.
  • Have the ability and willingness to transfer knowledge to internal Medscheme teams.
  • Be outcome-oriented and accountable for delivering agreed technical outcomes.
Key Deliverables

The successful candidate will be expected to deliver:

  • Future-state data platform MVP
  • Snowflake-based data models and pipelines
  • Automated data ingestion and transformation processes
  • Automated testing and data quality controls
  • Monitoring and reliability mechanisms
  • Foundational architecture for future platform phases
  • Reusable data engineering standards, frameworks and patterns
  • Power BI reporting layer supporting the MVP
  • Documentation and knowledge transfer to internal teams
Environment

The role will operate within a healthcare / medical scheme administration environment, where data may include sensitive health-related information. Strong attention to data security, governance, privacy and regulatory requirements is therefore essential.

Experience working with POPIA-sensitive or other regulated data environments will be highly advantageous.

Contract Details

Role: Senior Data Engineer
Industry: Healthcare / Medical Scheme Administration
Location: Waterfall, Midrand, Johannesburg
Work Model: Hybrid
Contract Duration: 5 months
Start Date: 1 October 2026
Application Requirements

Interested candidates should submit an updated CV clearly highlighting:

  • Hands-on Snowflake experience
  • dbt experience
  • AWS experience
  • Fivetran experience
  • Advanced SQL and data modelling
  • Data pipeline and platform engineering experience
  • Automated data quality and testing
  • CI/CD and DataOps implementation
  • Power BI experience
  • Experience working with regulated, sensitive or healthcare data, where applicable
  • Availability from 1 October 2026

Candidates with strong hands-on experience across the complete required technology stack are strongly encouraged to apply.



Skills Required

  • Hands-on experience with Snowflake
  • Hands-on experience with dbt
  • Hands-on experience with AWS
  • Hands-on experience with Fivetran
  • Hands-on experience with Power BI
  • Advanced SQL skills
  • Data modeling experience
  • Modern cloud data engineering experience
  • Data pipeline and platform engineering experience
  • Automated data quality and testing experience
  • CI/CD for analytics engineering
  • DataOps experience
  • Metadata management experience
  • Data integration and pipeline development experience
  • Experience designing scalable data platforms and pipelines
  • Ability to work independently with minimal supervision
  • Strong problem-solving and analytical capabilities
  • Understanding of data governance, security, quality, and metadata management
  • Effective communication with technical and non-technical stakeholders
  • Ability and willingness to transfer knowledge to internal teams
  • Experience working with POPIA-sensitive or other regulated data environments
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
22 Employees
Year Founded: 2013

What We Do

Blue Pearl is a market-leading CLOUD Solutions developer with extensive knowledge and insight into the latest technologies, standardised processes, advanced technical capabilities and consulting processes available, ensuring wholistic success for our clientele. We offer professional consulting to compliment your business strategy and overall management and make it our priority to add value to any business by listening, analysing and creating a conducive solution that will empower our client. We implement a Data Analysis Process that includes inspecting, cleansing, transforming, and modelling data with the end-goal of discovering useful information, informing conclusions, and relevant information to support your decision-making. Your business cannot afford not to engage with us, allowing our data analysis to play a role in making your business decisions more scientific and helping your business achieve effective operation. Blue Pearl’s team of experts include BI strategists, BI analysts, Data Warehouse Architects, Data Scientists, Implementation and Development experts. With the use of BI, Analytics and Big Data, we effectively partner with our customers on their mission to achieve a competitive business advantage and real ROI from the structured information we collect.

Similar Jobs

Sabenza IT Logo Sabenza IT

Senior Data Engineer

Agency • Information Technology • Professional Services
In-Office
Johannesburg, City of Johannesburg, Gauteng, ZAF

Blue Pearl HQ Logo Blue Pearl HQ

Senior Data Analyst

Information Technology • Pet • Professional Services
In-Office
Johannesburg, City of Johannesburg, Gauteng, ZAF
22 Employees

Blue Pearl HQ Logo Blue Pearl HQ

Senior Data Engineer

Information Technology • Pet • Professional Services
In-Office
Johannesburg, City of Johannesburg, Gauteng, ZAF
22 Employees

Iress Logo Iress

Senior Data Engineer

Information Technology • Software
In-Office
Johannesburg, Gauteng, ZAF
2000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account