Data Platform Engineer

Posted 2 Days Ago
Be an Early Applicant
Melbourne, Victoria, AUS
Hybrid
Mid level
Professional Services • Social Impact • Financial Services
The Role
Build and maintain a scalable Azure-based data platform (ADF, Databricks, Synapse, Azure SQL). Design batch and streaming pipelines, implement lakehouse/Delta Lake architectures, enable CI/CD and IaC, monitor performance/cost, support AI/ML workloads, ensure security and governance, and partner with analytics and AI teams to deliver trusted data for insights.
Summary Generated by Built In
Company Description

Fairness feels good

Make a real impact at AFCA. Where fairness drives every decision. Help us deliver world-class, independent complaints resolution for Australians. As a not-for-profit and progressive financial ombudsman, we’re championing positive change. Achieving our purpose takes progressive thinking, accountability and resilience. At AFCA, our inclusive leadership values every voice. We offer our people flexible work options, thoughtful benefits and opportunities to deepen expertise. Flourish in a diverse, caring culture. Feel the difference of belonging to an organisation intentionally designed to put people first.

Job Description

As a Data Platform Engineer, you’ll be at the heart of building and evolving our modern data platform, powered by Azure Data Factory, Azure SQL, Databricks, Synapse Analytics, and AI Foundry. This platform is critical to how we deliver analytics, insights, and AI capability across the organisation.

You’ll ensure the platform is reliable, scalable, and high-performing, enabling trusted data delivery at pace, while playing a key role in supporting AFCA’s growing data and AI ambitions.

Staying ahead of cloud-native innovation, you’ll continuously look for ways to enhance architecture, drive automation, and improve efficiency, helping future-proof our platform and keep us aligned to our enterprise vision.

What you’ll be doing:

  • Design, build and maintain scalable data pipelines, lake and lakehouse architectures across Azure (ADF, Databricks, Synapse, Azure SQL)
  • Develop robust batch and streaming pipelines to deliver reliable, high-quality data across the organisation
  • Drive best practice through CI/CD, infrastructure as code, automated testing and observability
  • Monitor and optimise performance, cost and reliability (clusters, jobs, queries and governance)
  • Contribute to data models and architectures that enable analytics and AI/ML use cases
  • Ensure solutions align with security, privacy and data governance standards
  • Partner closely with data analysts, engineers, scientists and AI teams to improve platform capability and developer experience

Qualifications

To be successful in this role, you will need:

  • Strong experience in data engineering or data platform roles, with demonstrated hands-on expertise in Azure Data Factory, Azure SQL, Databricks, Synapse Analytics and the broader Azure data ecosystem or similar (e.g. Fabric).  
  • A Bachelor degree in Computer Science, Information Systems or relevant field
  • Proficiency in SQL, Python, PySpark and Spark SQL, with experience building and optimising data pipelines at scale.  
  • Experience with lakehouse, Delta Lake and medallion architecture patterns. Familiarity with infrastructure-as-code tools (e.g. Terraform, ARM) and Azure DevOps CI/CD practices for data platform deployments.  
  • Understanding of data modelling concepts, data warehousing principles and modern data platform architectures.  
  • Exposure to supporting AI/ML workloads on Databricks (e.g. MLflow, model serving, feature engineering) highly regarded.  
  • Experience with or exposure to Azure AI Foundry highly regarded.  
  • Experience in financial services, digital‑first organisations or highly regulated environments highly regarded. 
  • Excellent stakeholder management skills, with the ability to clearly communicate end elicit requirements from non-technical audiences. 
  • Growth mindset with a practical, outcome‑focused approach. 
  • Customer‑centred, pragmatic and delivery‑oriented. 

Additional Information

  • Silver AWEI Accreditation 2025 – Recognised for LGBTQ+ workplace inclusion.
  • Accredited Family Friendly Workplace – Supporting work-life balance and inclusivity.
  • Hybrid working – Flexible arrangements with two days a week in our modern offices designed for collaboration and wellbeing.
  • Additional and inclusive leave options – Flexible public holidays, gender affirmation leave, women’s health leave, and bonus paid time off over the end of year holiday period.

To apply

If you’re passionate about fairness and believe your skills align with this role, we encourage you to apply even if you don’t meet every single criterion.

We welcome applications from people of all backgrounds, cultures, abilities, sexual orientations, and gender identities. If you require any accessibility support during the recruitment process, please reach out to our team at [email protected].

We believe fairness starts with people. That’s why we don’t use AI or automated tools to screen candidates. As a result, our processes may take a little longer, and we thank you for your patience.

About AFCA

The Australian Financial Complaints Authority (AFCA) was established in 2018 as a private not-for-profit ombudsman service providing free, fair and independent help with financial disputes. The original team has grown to over 1600 dedicated professionals. Since 2018, AFCA has received more than 634,000 complaints, helping to secure $2.1 billion in compensation for consumers. 

AFCA is a 2026 Circle Back Initiative Employer - we are committed to responding to every applicant.

Skills Required

  • Hands-on expertise in Azure Data Factory, Azure SQL, Databricks, and Synapse Analytics
  • Bachelor degree in Computer Science, Information Systems or relevant field
  • Proficiency in SQL, Python, PySpark and Spark SQL with experience building and optimising data pipelines at scale
  • Experience with lakehouse, Delta Lake and medallion architecture patterns
  • Familiarity with infrastructure-as-code tools (e.g., Terraform, ARM) and Azure DevOps CI/CD practices
  • Understanding of data modelling concepts, data warehousing principles and modern data platform architectures
  • Exposure to supporting AI/ML workloads on Databricks (e.g., MLflow, model serving, feature engineering)
  • Experience with or exposure to Azure AI Foundry
  • Experience in financial services, digital-first organisations or highly regulated environments
  • Excellent stakeholder management and ability to elicit requirements from non-technical audiences
  • Growth mindset with a practical, outcome-focused approach
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
1,000 Employees
Year Founded: 2018

What We Do

The Australian Financial Complaints Authority (AFCA) is a private not-for-profit ombudsman service established in 2018 to provide free, fair, and independent help with financial disputes in Australia. As an external dispute resolution (EDR) company, AFCA assists consumers and small businesses who are unable to resolve complaints with member financial services organisations, championing positive change through independent, world-class complaints resolution.

Similar Jobs

Xero Logo Xero

Business Operations Manager

Cloud • Fintech • Information Technology • Machine Learning • Software
Hybrid
Melbourne, Victoria, AUS
4500 Employees

McCain Foods Logo McCain Foods

Sales Representative

Food • Retail • Agriculture • Manufacturing
In-Office
Melbourne, Victoria, AUS
20000 Employees

Block Logo Block

Manager, Business Development

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office
Melbourne, Victoria, AUS
12000 Employees

McCain Foods Logo McCain Foods

National Business Manager, Foodservice Distributors

Food • Retail • Agriculture • Manufacturing
In-Office
Melbourne, Victoria, AUS
20000 Employees

Similar Companies Hiring

Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account