Senior Data Engineer

Posted Yesterday
Be an Early Applicant
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
In-Office
Senior level
Fintech • Payments • Software • Financial Services
The Role
Design, develop, test and deploy Spark-based ETL pipelines for the Gold layer using Medallion Architecture. Implement transformations, aggregations and data quality checks; support monitoring, troubleshoot pipelines, collaborate with analysts and engineering teams, follow governance and CI/CD practices, and contribute to documentation and continuous improvement.
Summary Generated by Built In

ABOUT US

We’re the world’s leading provider of secure financial messaging services, headquartered in Belgium. We are the way the world moves value – across borders, through cities and overseas. No other organisation can address the scale, precision, pace and trust that this demands, and we’re proud to support the global economy. 

We’re unique too. We were established to find a better way for the global financial community to move value – a reliable, safe and secure approach that the community can trust, completely. We’re always striving to be better and are constantly evolving in an ever-changing landscape, without undermining that trust. Five decades on, our vibrant community reflects the complexity and diversity of the financial ecosystem. We innovate diligently, test exhaustively, then implement fast. In a connected and exciting era, our mission has never been more relevant. Swift now has a presence in 200+ countries and legal territories to serve a community of more than 12,000 banks and financial institutions.   

Swift Senior Data Engineer

SWIFT is a member-owned cooperative that provides a communications platform, products, and services connecting more than 10,000 banking organizations, securities institutions, and corporate customers across 211 countries. As part of its Instant, Frictionless payments strategy, SWIFT is rapidly expanding its Data & Analytics capabilities to enhance customer understanding of payments processes.

Role Overview

The Data and Common Application Platform tribe is seeking a Senior Data Engineer who possesses strong technical abilities, leadership qualities, and a sense of responsibility. Working collaboratively with the team, the successful candidate will help leverage the foundations of the new Data Management Platform (DMP) and take part in designing, developing, testing, and deploying features and components to create new Data Products.

The squad is based in both Malaysia (Kuala Lumpur) and Belgium (La Hulpe).

Role Responsibilities

This position requires a Software Developer who will contribute to the design and implementation of the Gold layere of Swift’s Data Platform using the Medallion Architecture. The ideal candidate should have hands-on experience with JavaSpark, Airflow, a solid grasp of data engineering principles and ETL concepts, and an interest or background in the payment’s domain. The role involves collaborating closely with technical and other business teams to deliver a reliable, enriched and integrated business-ready datasets in the Gold layer.

  • Building and maintaining Spark-based pipelines for the Gold layer of the Data Warehouse. 
  • Implement business-driven transformations and aggregations under guidance from senior engineers or architects. 
  • Apply data quality checks to ensure accuracy, consistency, and reliability of datasets. 
  • Collaborate with data analysts and other engineering teams to support reporting and business requirements. 
  • Support pipeline monitoring and troubleshooting to maintain operational stability. 
  • Follow established data governance, security, and coding standards to ensure compliance and maintainability. 
  • Contribute to documentation and continuous improvement efforts, including process refinement and knowledge sharing.
Education
  • University degree in computer science or related field. Or equivalent work experience.
  • Minimum of 5 to 10+ years of relevant software development experience in an international setting.
  • Proven expertise in data engineering and software development practices, with the relevant technologies
Technical Skills Requirements

Must Have:

  • Hands-on experience in programming languages, particularly Java, and their design patterns.
  • Hands-on experience with the following data management tools such as: Spark and Airflow.
  • Experience with large-scale object storage services (Amazon S3 or equivalent is a plus).
  • Understanding of Data Engineering, data hub, data lake, and data warehousing concepts.
  • Experience with continuous integration and delivery build environments, including GIT, Jenkins, Maven, and coverage and static/dynamic code analysis tools.
  • Familiarity with Agile tools like JIRA, Confluence and Bitbucket.

Good to Have:

  • Understanding of containerization technologies such as OpenShift and Kubernetes.
  • Experience with Elasticsearch/Kibana.

Competency Profile

  • Adaptability and responsiveness to change.
  • Accountability for delivering results.
  • Strong written and oral communication skills.
  • Time management, planning, and organizing abilities.
  • Ability to thrive in both multi-cultural team and individual environments.
  • Quality-oriented approach.
  • Engaged and team-oriented attitude.
  • Open communication style.
  • Fluent in English.

What we offer

We give you the freedom to be yourself. We are creating an environment of unique individuals – like you – with different perspectives on the financial industry and the world. A diverse and inclusive environment in which everyone’s voice counts and where you can reach your full potential.

We are committed to an inclusive and accessible recruitment process. If you require a reasonable accommodation related to accessibility during your application or interview, please contact [email protected] or indicate this in your application.

Please note that this mailbox is not monitored for general recruitment enquiries and should only be used for accessibility or accommodation-related requests (for example related to vision, hearing or neurodiversity).

All requests are confidential and will not affect your candidacy.

Don’t meet every single requirement? At Swift, we are dedicated to building a workplace where people can bring their full selves and ideas to the team, so if you are excited about this role, we encourage you to apply even if you do not meet every single qualification.

Skills Required

  • University degree in computer science or related field or equivalent work experience
  • Minimum of 5 to 10+ years of relevant software development experience in an international setting
  • Hands-on experience in Java and related design patterns
  • Hands-on experience with Spark (Spark-based pipelines) and Apache Airflow
  • Understanding of data engineering, data hub, data lake, and data warehousing concepts
  • Experience with CI/CD and build environments including Git, Jenkins, Maven, and code coverage/static/dynamic analysis tools
  • Familiarity with Agile tools such as JIRA, Confluence and Bitbucket
  • Experience with large-scale object storage services (Amazon S3 or equivalent)
  • Understanding of containerization technologies such as OpenShift and Kubernetes
  • Experience with Elasticsearch and Kibana
  • Interest or background in the payments domain
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
4,765 Employees
Year Founded: 1973

What We Do

SWIFT is a global member-owned cooperative and the world’s leading provider of secure financial messaging services. We provide our community with a platform for messaging and standards for communicating, and we offer products and services to facilitate access and integration, identification, analysis and regulatory compliance. Our messaging platform, products and services connect more than 11,000 banking and securities organisations, market infrastructures and corporate customers in more than 200 countries and territories. SWIFT also brings the financial community together – at global, regional and local levels – to shape market practice, define standards and debate issues of mutual interest or concern. For more information, visit www.swift.com or follow us on Twitter: @swiftcommunity

Similar Jobs

Encora Logo Encora

Senior Data Engineer

Software • Consulting
In-Office
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
7456 Employees

NielsenIQ Logo NielsenIQ

Data Engineer

Big Data • Information Technology
Hybrid
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
40000 Employees

onsemi Logo onsemi

Senior Engineer

Automotive • Cloud • Energy
In-Office or Remote
3 Locations
11712 Employees

Ramboll Logo Ramboll

Senior Mechanical Engineer

Other • Consulting • Energy
In-Office
Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, MYS
18531 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account