Senior Data Engineer (Microsoft Fabric, PySpark, SQL)
Build a centralised, trusted data warehouse for internal technology insights using Microsoft Fabric.
Own complex engineering work across PySpark, SQL, medallion architecture and source-system integration.
Apply AI-powered engineering thoughtfully across coding, testing, deployment and documentation.
Do Work That Matters
Be part of the team driving enterprise-wide transformation at CommBank. In End User Experience team, you’ll help bring data from internal technology sources into a centralised Microsoft Fabric warehouse, creating a controlled and reusable foundation for reporting, analytics and data sharing across the organisation.
See yourself in our team
You’ll join a collaborative, Sydney-based team working across data engineering, analytics and business stakeholders. Your focus will be to design, build and improve scalable data solutions that turn complex source data into trusted, analytics-ready products.
Design and build data ingestion and transformation workloads in Microsoft Fabric using PySpark and advanced SQL.
Apply medallion architecture principles across Bronze, Silver and Gold layers to create governed, reusable data products.
Connect to and ingest data from APIs, web services, relational databases, files, cloud storage and event-based sources.
Design analytics-friendly data models, including facts, dimensions and curated datasets.
Implement data quality checks, reconciliation controls, validation, monitoring and robust error handling.
Translate business and technical requirements into data models, business rules and practical engineering solutions.
Use source control, automated testing, continuous integration and delivery practices, and clear technical documentation.
Collaborate with engineers, analysts, BI developers, architects and stakeholders in an Agile delivery environment.
We’re interested in hearing from people who:
Bring strong hands-on data engineering experience and can work confidently across design, development, troubleshooting and optimisation. You’ll combine technical depth with sound judgement, clear documentation and a collaborative approach.
Have strong hands-on experience with Microsoft Fabric, PySpark and advanced SQL.
Have extensive experience applying medallion architecture to enterprise data solutions.
Can develop and troubleshoot scalable ingestion, transformation and API-based integration patterns across multiple environments.
Understand data modelling, data lineage, metadata management, data quality and reconciliation controls.
Use generative AI and coding-assistant tools responsibly, including model selection, prompt and context design, cost awareness, output evaluation, security and human review.
Are familiar with Git, automated testing, continuous integration and delivery, and release management for data engineering solutions.
Can gather requirements and translate them into durable data models, rules and engineering outcomes.
Experience with T-SQL and dynamic SQL is desirable
Working with us:
At CommBank, we're committed to creating an accessible, inclusive and respectful workplace. If you require support or adjustments, please let us know. We welcome applications from people of all backgrounds and we're particularly committed to making a positive difference for Aboriginal and/or Torres Strait Islander Peoples. For support please contact 1800 989 696
If this sounds like you, apply now.
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Skills Required
- Hands-on experience with Microsoft Fabric
- Strong PySpark development experience
- Advanced SQL expertise
- Extensive experience applying medallion architecture (Bronze/Silver/Gold)
- Experience developing and troubleshooting scalable ingestion, transformation and API-based integrations
- Knowledge of data modelling, data lineage, metadata management, data quality and reconciliation controls
- Familiarity with Git, automated testing, CI/CD and release management for data engineering
- Experience with T-SQL and dynamic SQL
- Responsible use of generative AI and coding-assistant tools (model selection, prompt design, security, human review)
Commonwealth Bank Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Commonwealth Bank and has not been reviewed or approved by Commonwealth Bank.
-
Leave & Time Off Breadth — The bank offers additional Life Leave, the option to purchase up to four extra weeks, pet leave, and paid volunteering leave alongside flexible-working options. Public materials indicate these leave features compare well within Australian banking.
-
Parental & Family Support — Permanent employees can access up to 18 weeks of paid parental leave, and superannuation is paid for up to 34 weeks of unpaid parental leave. These provisions extend support for new parents beyond standard settings.
-
Wellbeing & Lifestyle Benefits — Access includes CBHS Health Fund, Fitness Passport, a 24/7 wellbeing platform with telehealth, an Employee Assistance Program, and employer‑paid income protection for up to two years, alongside staff banking perks and share plans. This combination provides day‑to‑day value across health, protection, and financial perks.
Commonwealth Bank Insights
What We Do
Australia’s leading provider of financial services including retail, premium, business and institutional banking, funds management, superannuation, insurance, investment and sharebroking products and services. We are a business with more than 800,000 shareholders and over 52,000 employees. We offer a full range of financial services to help all Australians build and manage their finances.
