Senior/Lead Data Engineer

Posted 9 Days Ago
Be an Early Applicant
Cape Town, Western Cape, ZAF
In-Office
Senior level
Agency • Information Technology • Professional Services
The Role
Lead design and delivery of scalable cloud-native data pipelines and platforms, enforce data architecture and governance, drive DevSecOps/CI-CD, mentor engineers, collaborate with stakeholders, and improve data quality and platform reliability.
Summary Generated by Built In
Our client is looking for an experienced Senior / Lead Data Engineer to join their growing Data Engineering team. This role is responsible for designing and delivering scalable cloud-based data solutions, leading technical initiatives, and mentoring engineers while driving best practices across enterprise data platforms.

RequirementsKey Responsibilities
  • Design, build and optimise enterprise data pipelines and data platforms.
  • Develop scalable cloud-native data engineering solutions.
  • Collaborate with business and technical stakeholders to deliver data-driven solutions.
  • Define and maintain data architecture and engineering standards.
  • Drive DevSecOps and CI/CD best practices.
  • Mentor and coach Data Engineers.
  • Ensure data quality, governance and platform reliability.
  • Participate in Agile ceremonies and technical planning.
  • Drive continuous improvement and innovation across the data environment.
Requirements
  • Bachelor's Degree or Diploma in Computer Science, Engineering, Mathematics, Information Systems or similar.
  • 8+ years' experience in Data Engineering or Software Engineering.
  • Strong experience with Business Intelligence and Data Warehousing.
  • Advanced SQL skills.
  • Expert knowledge of Python and PySpark.
  • Experience with Hadoop and Apache Spark.
  • Strong AWS experience, including EMR, S3, Athena, RDS, Lambda and API Gateway.
  • Good understanding of SDLC, Solution Architecture and DevSecOps.
  • Experience with Azure, Google Cloud Platform and Snowflake is advantageous.
  • Previous experience leading or mentoring engineering teams.
  • Retail or FMCG industry experience is essential.
Technical Skills
  • Python
  • PySpark
  • SQL
  • AWS
  • Hadoop
  • Apache Spark
  • Data Warehousing
  • Business Intelligence
  • ETL / ELT
  • Snowflake
  • Azure
  • Google Cloud Platform
  • DevSecOps
  • CI/CD
  • Solution Architecture


Skills Required

  • Bachelor's Degree or Diploma in Computer Science, Engineering, Mathematics, Information Systems or similar
  • 8+ years' experience in Data Engineering or Software Engineering
  • Strong experience with Business Intelligence and Data Warehousing
  • Advanced SQL skills
  • Expert knowledge of Python and PySpark
  • Experience with Hadoop and Apache Spark
  • Strong AWS experience including EMR, S3, Athena, RDS, Lambda and API Gateway
  • Good understanding of SDLC, Solution Architecture and DevSecOps
  • Previous experience leading or mentoring engineering teams
  • Retail or FMCG industry experience
  • Experience with Azure, Google Cloud Platform and Snowflake
  • Experience with ETL / ELT and CI/CD practices
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Year Founded: 2013

What We Do

Sabenza IT is a niche recruitment company specializing in Information Technology, SAP, Finance, and Engineering roles, with over 23 years of experience.

Similar Jobs

Xero Logo Xero

Head Of Marketing

Cloud • Fintech • Information Technology • Machine Learning • Software
Hybrid
Kenridge, City of Cape Town, Western Cape, ZAF
4500 Employees

Xero Logo Xero

Account Executive

Cloud • Fintech • Information Technology • Machine Learning • Software
Hybrid
Kenridge, City of Cape Town, Western Cape, ZAF
4500 Employees

Datadog Logo Datadog

Technical Account Manager

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
South Africa
6500 Employees

Xero Logo Xero

Senior Marketing Manager

Cloud • Fintech • Information Technology • Machine Learning • Software
Hybrid
Kenridge, City of Cape Town, Western Cape, ZAF
4500 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account