Senior Data Engineer (Scala/Java, Spark, AWS)

Posted 3 Days Ago
Be an Early Applicant
2 Locations
In-Office
Senior level
Fintech • Financial Services
The Role
Senior Data Engineer responsible for designing, building and operating scalable cloud data platforms using Scala/Java, Spark and AWS. Deliver ETL pipelines, data modelling, pipeline orchestration, performance tuning, automated testing, and secure data controls. Engage stakeholders, produce technical designs and documentation, mentor engineers, and provide staff-like ownership on initiatives within Financial Crimes Intelligence.
Summary Generated by Built In

Senior Data Engineer (Scala/Java, Spark, AWS)

  • We're embarking on an exciting Data Transformation program and are ready to push the boundaries and deliver engineering best practices to elevate the data quality and availability in our domain

  • You have knowledge and experience that spans both development and architecture, including data engineering, modelling and cloud architecture

  • Together we will build tomorrow’s bank today, using world-leading engineering, technology, and innovation.

Do Work That Matters
We're building tomorrow’s bank today, which means we need creative and diverse engineers to help us redefine what customers expect from a bank. Envisioning new technologies that are still waiting to be invented and reimagining products that support our customers and help build Australia’s future economy. 
 
Here, you'll have the chance to bring your passion to life by working with the latest technology on groundbreaking projects that deliver a seamless and unmatched customer experience.  
See Yourself in Our Team
This role is part of the Monitoring & Payments Crew within Financial Crimes Intelligence domain, where we design and deliver cutting-edge technology solutions that serve data and analytical use-cases within Financial Crimes domain.

We are seeking an outstanding Senior Data Engineer to join our team and contribute to building and evolving our data and analytics cloud platforms through strong hands‑on engineering, with the ability to step up into broader (staff‑like) ownership when required.

We’re interested in hearing from people who:

  • Can build and evolve our data and software engineering platforms, delivering scalable, resilient solutions in a cloud‑based environment.

  • Can independently deliver well‑scoped technical solutions from design through build, testing, release, and support seeking input early when problems are ambiguous or cross‑cutting.

  • Possess a strong security‑first and risk mindset, particularly when handling high‑risk and sensitive data in regulated environments such as Financial Crime.

  • Can engage with business and technical stakeholders to translate requirements into clear, pragmatic technical designs.

  • Can contribute to mentoring and knowledge sharing through pairing and constructive code reviews.

  • Can step up to provide staff‑like ownership for a small initiative (e.g., driving a design, aligning stakeholders, and improving team practices) when required.

Skills Required:
We use a broad range of tools, languages, and frameworks. We do not expect you to know them all but experience or exposure with some of these, or a willing to learn these skillsets (or equivalents) will set you up for success in this team!

  • Strong, hands‑on experience with Scala/ Java for building large‑scale, distributed data and software systems.

  • Experience designing and implementing solutions on AWS, leveraging cloud‑native services for scalable and resilient architectures.

  • Solid foundation in data engineering, including ETL pipeline design, data modelling, and large‑scale data processing.

  • Strong experience with Apache Spark (good to have EMR exp) and distributed data processing frameworks.

  • Demonstrated ability to handle and process large data volumes efficiently, balancing performance, scalability, reliability, and cost.

  • Experience orchestrating pipelines, including dependency handling, retries, and operational resilience.

  • Experience in performance tuning and optimisation across Spark workloads and cloud infrastructure.

  • Experience designing and implementing automated testing approaches for data and software systems, including:

  • Unit testing and integration testing for Scala‑based services and pipelines

  • Testing of Spark jobs and data transformations

  • Data quality, validation, and regression testing within pipelines

  • Strong understanding of secure data engineering practices, particularly when working with high‑risk or sensitive data.

  • Hands‑on experience implementing data security controls, such as encryption at rest and in transit, secrets management, data masking, and fine‑grained access control.

  • Sound knowledge of software engineering best practices, including CI/CD, automated testing, code reviews, and version control (GitHub).

  • Ability to produce clear technical documentation and lightweight design artefacts for engineers and for architecture/cyber security review when required.

  • Experience working with agile delivery practices and tools such as JIRA and Confluence.

  • Certification: Either Quantexa certification (Data Engineering or Scoring) or an AWS certification is desirable.

  • Experience working with Quantexa platforms, upgrades, or financial crime data domains is advantageous.

Working with us:

Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.  

Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across all of Australia and have opened technology hubs in Melbourne and Perth. We really love working here, and we think you will too.

We support our people with the flexibility to balance where work is done with at least half their time each month connecting in office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work in the role you’re interested in.

If this sounds like the role for you then we would love to hear from you. Apply today!

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 29/06/2026

Skills Required

  • Strong hands-on experience with Scala and Java for building large-scale distributed data and software systems
  • Experience designing and implementing solutions on AWS using cloud-native services
  • Solid foundation in data engineering including ETL pipeline design, data modelling, and large-scale data processing
  • Strong experience with Apache Spark (EMR experience is good to have)
  • Demonstrated ability to handle and process large data volumes balancing performance, scalability, reliability and cost
  • Experience orchestrating pipelines including dependency handling, retries, and operational resilience
  • Experience in performance tuning and optimisation across Spark workloads and cloud infrastructure
  • Experience designing and implementing automated testing approaches for data and software systems (unit and integration testing for Scala services, testing Spark jobs, data quality/validation/regression testing)
  • Strong understanding of secure data engineering practices when working with high-risk or sensitive data
  • Hands-on experience implementing data security controls such as encryption at rest/in transit, secrets management, data masking and fine-grained access control
  • Sound knowledge of software engineering best practices including CI/CD, automated testing, code reviews and version control (GitHub)
  • Ability to produce clear technical documentation and lightweight design artefacts for engineers and architecture/cyber security review
  • Experience working with agile delivery practices and tools such as JIRA and Confluence
  • Quantexa certification (Data Engineering or Scoring) or an AWS certification
  • Experience working with Quantexa platforms, upgrades, or financial crime data domains
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sydney, New South Wales
52,000 Employees
Year Founded: 1911

What We Do

Australia’s leading provider of financial services including retail, premium, business and institutional banking, funds management, superannuation, insurance, investment and sharebroking products and services. We are a business with more than 800,000 shareholders and over 52,000 employees. We offer a full range of financial services to help all Australians build and manage their finances.

Similar Jobs

CrowdStrike Logo CrowdStrike

Regional Sales Manager

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
Spain
10000 Employees

SEON Logo SEON

Senior Site Reliability Engineer

Artificial Intelligence • Cybersecurity
In-Office or Remote
28 Locations
415 Employees

SailPoint Logo SailPoint

Manager, Professional Services

Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
2 Locations
2461 Employees

Deepgram Logo Deepgram

Research Staff, LLMs

Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
In-Office or Remote
49 Locations
150 Employees
150K-250K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account