Big Data Support Engineer

Posted Yesterday
Be an Early Applicant
Sandton, Sandown, Johannesburg, Gauteng
In-Office
Mid level
Financial Services
The Role
Provide application support for big data products using Hadoop ecosystem, optimize data pipelines, troubleshoot issues, and code applications.
Summary Generated by Built In
Empowering Africa’s tomorrow, together…one story at a time.

With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group.

Job Summary

Work as part of an agile team to provide application support for specified tech products & services. This includes first line support & basic optimization, administration, configuration, maintenance & trouble shooting / problem solving with end users of these tech products & services.

Job Description

Team Context

Data Engineering is responsible for the central data platform that receives and distributes data across the bank. This is a multi-platform environment and leverages a blend of custom, commercial and open-source tools to manage and support thousands of critical data-related jobs. These jobs are supported and updated in line with changes across the landscape to avoid disruption to downstream data consumers.

 

Job Description

In this role, you will be part of the Data Operations team that is responsible for supporting all the applications on the Hadoop ecosystem. This role expands in maintaining changes on datasets and optimisation activities on all applications, including new development. They therefore need to understand basic programming to enable them to manage Big Data and to transfer all data to Hadoop.

Education: Bachelor’s degree in Computer Science, Information Systems or related field.

Job Experience & Skills Required:

  • 2+ years’ experience working in Big data environment, optimising and building big data pipelines, architectures and data sets with e.g. Java, Scala, Python, Hadoop, Apache Spark and Kafka

  • Familiarity with Hadoop ecosystem and its components

  • Good knowledge of the concepts of Hadoop

  • Solid experience in a working environment in Big Data development utilising SQL or Python

  • Experience in Big Data development using Spark

  • Experience in Hadoop, HDFS and MapReduce

  • Experience in database design, development and data modelling

The following additional knowledge, skills and attributes are preferred:

  • Good knowledge in back-end programming, specifically java

  • Experience with development in a Linux environment and its basic commands

  • Ability to write reliable, manageable, and high-performance code

  • Should have basic knowledge of SQL, database structures, principles, and theories

  • Knowledge of workflow/schedulers

  • Strong collaboration and communication skills

  • Strong analytical and problem solving skills

Responsibilities

  • Support pipelines end to end

  • Build enhancements and new developments

  • Build and deploy new data pipelines

  • Identify optimisation opportunities

  • Improvement on recovery time in case of prod failures

  • Test prototypes and oversee handover to the Data Operations teams

  • Attend and contribute to regular team and User meetings

  • Responsible for the actual coding or programming of Hadoop applications

  • High-speed querying

Education

Bachelor's Degree: Information Technology

Absa Bank Limited is an equal opportunity, affirmative action employer. In compliance with the Employment Equity Act 55 of 1998, preference will be given to suitable candidates from designated groups whose appointments will contribute towards achievement of equitable demographic representation of our workforce profile and add to the diversity of the Bank.

Absa Bank Limited reserves the right not to make an appointment to the post as advertised

Top Skills

Spark
Hadoop
Java
Kafka
Python
Scala
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Johannesburg
39,055 Employees
Year Founded: 2018

What We Do

Absa Group Limited (Absa) has forged a new way of getting things done, driven by bravery and passion, with the readiness to realise growth on the African continent and beyond.

We’re a truly African brand, inspired by the people we serve in Botswana, Ghana, Kenya, Mauritius, Mozambique, Seychelles, South Africa, Tanzania, Uganda, and Zambia. We also have representative offices in China, Namibia, Nigeria and the United States, as well as securities entities in the United Kingdom and the United States, along with technology support colleagues in the Czech Republic.

Similar Jobs

Mondelēz International Logo Mondelēz International

Legal Counsel

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Hybrid
Johannesburg, Gauteng, ZAF
90000 Employees

TransUnion Logo TransUnion

Advisor External Communications

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Johannesburg, Gauteng, ZAF
13000 Employees

Mastercard Logo Mastercard

Consultant

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Sandton, City of Johannesburg, Gauteng, ZAF
38800 Employees

TransUnion Logo TransUnion

Senior Consultant

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Johannesburg, Gauteng, ZAF
13000 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Rain Thumbnail
Web3 • Payments • Infrastructure as a Service (IaaS) • Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
70 Employees
Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account