Data Engineer-Unified data platform

Posted 3 Days Ago
Be an Early Applicant
Sydney, New South Wales, AUS
In-Office
Entry level
Information Technology • Software • Consulting
The Role
Build and maintain batch and streaming data pipelines, workflow orchestration, and cloud object-storage architectures. Integrate data engineering outputs with real-time decisioning platforms such as Pega for personalization and customer engagement. Collaborate with DevOps, architects, analytics, QA, and operations teams to ensure data quality, governance, observability, and reliable releases. Support Agile delivery, technical documentation, dependency management, SIT, UAT, and data validation across environments.
Summary Generated by Built In

Demonstrate a sound understanding of:

 

Ingestion and transformation of data from multiple source domains (e.g. CRM feeds, third-party data, digital signals) into the platform following approved design principles and data governance standards.

Building and maintaining batch and streaming transform pipelines and workflow orchestration.

Data dictionary documentation and cloud object storage design for data offload scenarios.

Collaboration with extended team like DevOps, Data Architects, and operations teams to ensure end-to-end pipeline reliability and observability.

Decisioning Platform (Pega or equivalent)

 

Demonstrate a sound understanding of how real-time decisioning platforms (such as Pega) consume and depend on data engineering outputs.

Work with decisioning and analytics teams to ensure accurate and timely data availability for personalisation and customer engagement use cases.

Participate in cross-team planning and technical reviews as they relate to data dependencies for decisioning workflows.

Cross-Platform & Delivery

 

Deliver across multiple use cases simultaneously in an Agile squad model, managing dependencies across platforms and teams.

Author and maintain technical documentation, including solution design notes, implementation plans, and deployment runbooks.

Actively participate in sprint ceremonies, backlog refinement, and cross-team dependency management.

Provide SIT, UAT, and data validation support across environments; work with QA and operations teams to validate data integrity pre- and post-release.

 

Skills & Experience

Familiarity with cloud-native data engineering patterns and object storage-based data offload architectures (e.g. AWS S3, Azure Data Lake).

Understanding of real-time decisioning platforms such as Pega, and how they integrate with data engineering layers.

Exposure to MarTech or Transformation data programs in a large enterprise or telco context.

Experience with workflow orchestration tools such as Apache Airflow or equivalent.

Understanding of data governance frameworks, data lineage, and data quality processes.

Knowledge of Agile or SAFe delivery methodology and working in cross-functional squads

Skills Required

  • Understanding of ingesting and transforming data from multiple source domains into governed data platforms
  • Experience building and maintaining batch and streaming transformation pipelines
  • Experience with workflow orchestration tools such as Apache Airflow or equivalent
  • Understanding of cloud-native data engineering patterns and object storage architectures, including AWS S3 or Azure Data Lake
  • Understanding of real-time decisioning platforms such as Pega and their integration with data engineering layers
  • Knowledge of data governance, data lineage, and data quality processes
  • Experience with data dictionary documentation and technical solution documentation
  • Experience supporting SIT, UAT, data validation, QA, and production releases
  • Experience working in Agile or SAFe cross-functional squads
  • Exposure to MarTech or transformation data programs in a large enterprise or telecommunications context
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Melbourne
120 Employees
Year Founded: 2016

What We Do

XPT Software Australia Pty Ltd is a technology consulting and software services company serving clients across banking, financial services and insurance, telecommunications, mining, retail, energy, and manufacturing. It provides software development, IT management consulting, business analysis, project and program management, infrastructure support, and offshore development through onsite-offshore delivery. The company also works with cloud computing, big data, mobile applications, UI/UX, algorithms, and IoT.

Similar Jobs

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Concession Manager

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Sydney, New South Wales, AUS
16000 Employees

Atlassian Logo Atlassian

Senior Manager, Implementation

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
3 Locations
11000 Employees

Klaviyo Logo Klaviyo

Director, Mid Enterprise Sales

Consumer Web • eCommerce • Marketing Tech • Retail • Software • Analytics • Generative AI
Easy Apply
Hybrid
Sydney, New South Wales, AUS
2400 Employees
240K-360K Annually

monday.com Logo monday.com

Sales Development Representative

Artificial Intelligence • Productivity • Sales • Software
Hybrid
Sydney, New South Wales, AUS
3155 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account