Senior Data Engineer

Posted 19 Hours Ago
Hiring Remotely in Square, Newry Mourne and Down, Northern Ireland, GBR
Remote
Senior level
Fintech • Financial Services
The Role
Lead and mentor a squad building and operating CDC and streaming data pipelines from DB2/VSAM/Oracle to Kafka and HDFS. Ensure platform reliability, security, compliance, incident response, scalable designs, service SLAs, tooling standards, and stakeholder/vendor management while driving continuous improvement.
Summary Generated by Built In

Mō te tūranga | About the Role

The Senior Data Engineer not only provides expert domain knowledge and expertise in the area they are working in, but as a senior member of the squad, provides mentorship and guidance to others. They operate with greater scope within the service group, wider technology business unit and with business stakeholders to ensure high levels of Service Delivery are maintained and an overarching focus on risk and compliance is always front of mind in the squad.

Communication, negotiation, collaboration and teamwork, and partnership/relationship building skills are key to achieving desired outcomes in this role. In particular to enable the delivery of great innovative banking products that continue to enhance our customers’ experience.

The CDC Squad develops and maintains the data pipelines that capture changes from hundreds of tables across DB2 z/OS, DB2 LUW, VSAM, and Oracle and stream them to Kafka and HDFS. Our data supports analytics, regulatory reporting, and other engineering squads across the bank. We also do other work from time to time to support the wider service group.  

What you’ll do:

  • Provide technical leadership and guidance within the squad, shaping engineering practices, solution design, and platform stability.
  • Ensure CDC platforms, data products, and pipelines remain reliable, secure, compliant, and aligned with organisational risk and regulatory requirements.
  • Drive the resolution of complex production issues, including coordinating on-call coverage, early life support and critical incident response.
  • Translate business and architecture requirements into scalable technical designs, ensuring consistency with wider Technology patterns and standards.
  • Maintain and improve service operations by ensuring SLAs, monitoring, and system health metrics are consistently met.
  • Contribute to squad level standards for engineering quality, tooling, coding practices, documentation, and deployment processes.
  • Mentor engineers, fostering technical growth, capability uplift, and a culture of excellence across the squad.
  • Support prioritisation alongside Leads, Service Owners, and Delivery Leads, advising on scope, timelines, and technical dependencies.
  • Lead problem investigations, root‑cause analysis, and continuous improvement initiatives to enhance platform stability and performance.
  • Manage relationships with internal stakeholders, third‑party vendors, and platform partners to ensure the delivery of high‑quality outcomes.

Nā tāu rourou | What will you bring?

  • 5+ years of experience in software development, data engineering, platform engineering, or a related technical discipline.
  • Solid understanding of CDC patterns and data streaming patterns.
  • Strong programming skills in Java and Python.
  • Deep experience with the Kafka stack, building real-time publishers and consumers.
  • Familiarity with the Hadoop stack, particularly HDFS and Spark.
  • Experience orchestrating data workflows with Airflow.
  • Knowledge of data encryption standards and secure software development practices. // Can we get rid of this? Or switch to something like “Awareness of secure software development practices for handling sensitive data”
  • Experience with Terraform, CI/CD pipelines and containerisation.
  • Familiarity with code quality and security scanning tooling such as SonarQube and Snyk.
  • Demonstrated ability to assess new technologies, review vendor solutions, and recommend improvements to existing engineering approaches.
  • Proven capability in diagnosing and resolving complex technical issues throughout the application lifecycle.
  • Strong understanding of quality assurance, testing frameworks, and continuous improvement.
  • Tertiary qualifications in Computer Science, Information Systems, Engineering, or related discipline, with relevant technical certifications preferred.
  • Demonstrated ability to mentor, support and grow engineers.
  • Comfortable in Agile delivery and modern DevOps practices.

Westpac Hei Wāhi Mahi | Working at Westpac EDIT ACCORDINGLY FOR FIXED TERM/CASUAL
In addition to immersing yourself in a supportive team environment, you'll receive some great job perks and benefits including:

  • 4 weeks standard holiday + 5 additional days of wellbeing leave to support you to be your best
  • Additional purchased leave options up to 4 weeks per year
  • Banking benefits, insurance discounts and superannuation scheme
  • Growth and development – we provide opportunities for development and promote internal mobility
  • Recognition - we recognise and reward our star performers
  • School holiday subsidy - help you balance work and family during school holiday
  • 2 Volunteer days per year

Ko mātou tēnei | Our Organisation
At Westpac, we’re working together to build a fairer and stronger New Zealand for our people, customers, and communities. For over 160 years we’ve been driven by our purpose to Create Better Futures Together.

What makes us unique are the incredible people we’re lucky enough to have walk through our doors every day. The giant ‘W’ on our building doesn’t just stand for Westpac – it says, double you. We’re a place that values, rewards and recognises individuality. Where you can be your whole self, your true self, and your best self. We’re recognised as a place where talent is developed, where passions are fuelled and where ambitions of all shapes and sizes thrive. And it all starts with you!

Tono mai ināianei! | Apply Now!

Apply today with your CV and Cover Letter. 

The people of Aotearoa, New Zealand hail from many cultures and backgrounds. At Westpac New Zealand, we draw on this enormous talent pool to cultivate a team rich in ability and empowered to reach its full potential. Our aim is to be brave challengers, celebrating our differences and relentlessly advocating for our customers. It starts with us – we believe that when we care deeply and do our best for our people, they’ll do their best for our customers. We encourage people from all walks of life to apply, including those who are neurodiverse, have chronic health conditions or disabilities – your attitude and passion are as important to us as your experience, qualifications and capabilities. 

Mahi tahi tātou, kaha ake tātou | Together Greater

Applications close:

22 July 2026

Skills Required

  • 5+ years of experience in software development, data engineering, platform engineering, or related technical discipline
  • Solid understanding of CDC patterns and data streaming patterns
  • Strong programming skills in Java and Python
  • Deep experience with the Kafka stack, building real-time publishers and consumers
  • Familiarity with the Hadoop stack, particularly HDFS and Spark
  • Experience orchestrating data workflows with Airflow
  • Awareness / knowledge of data encryption standards and secure software development practices for handling sensitive data
  • Experience with Terraform, CI/CD pipelines and containerisation
  • Familiarity with code quality and security scanning tooling such as SonarQube and Snyk
  • Demonstrated ability to assess new technologies, review vendor solutions, and recommend engineering improvements
  • Proven capability in diagnosing and resolving complex technical issues throughout the application lifecycle
  • Strong understanding of quality assurance, testing frameworks, and continuous improvement
  • Tertiary qualifications in Computer Science, Information Systems, Engineering, or related discipline (technical certifications preferred)
  • Demonstrated ability to mentor, support and grow engineers
  • Comfortable in Agile delivery and modern DevOps practices
  • Experience working with source systems including DB2 z/OS, DB2 LUW, VSAM, and Oracle

Westpac Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Westpac and has not been reviewed or approved by Westpac.

  • Leave & Time Off Breadth Extensive paid and unpaid leave options span wellbeing leave, Culture/Lifestyle/Wellbeing days, purchased leave up to 12 weeks, career breaks, and various specialized leaves. This breadth supports work-life balance and accommodates a wide range of personal circumstances.
  • Parental & Family Support Parental provisions include 16 weeks full pay (or 32 at half pay) for primary carers, four weeks for support carers, and continued superannuation during unpaid parental leave. Additional supports cover domestic and family violence leave, Family Pathways leave, and grandparental leave.
  • Wellbeing & Lifestyle Benefits Wellbeing resources include counselling and coaching services, workplace mental health training, free nutrition advice, and health insurance access with pre‑existing conditions covered if joined promptly. Financial and lifestyle perks include banking discounts for employees and families and the myDiscounts program.

Westpac Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Suwŏn
16,000 Employees
Year Founded: 1817

What We Do

Westpac is Australia’s oldest bank and company, one of four major banking organisations in Australia and one of the largest banks in New Zealand. We provide a broad range of banking and financial services in these markets, including consumer, business and institutional banking and wealth management services. We also have offices in key financial centres around the world including London, New York, Hong Kong and Singapore. Westpac Group's portfolio of financial services brands and businesses is focused on our vision, which is "To be one of the world’s great service companies, helping our customers, communities and people to prosper and grow.”

Similar Jobs

Intetics Logo Intetics

Senior Data Engineer

Artificial Intelligence • Blockchain • Internet of Things • Machine Learning • Software
Remote
6 Locations
532 Employees

Prolific Logo Prolific

Senior Data Engineer

Artificial Intelligence
Remote
UK
Remote
UK
112 Employees

Prolific Logo Prolific

Senior Data Engineer

Artificial Intelligence
Remote
UK

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account