Data Engineer - AWS

Posted 2 Days Ago
Be an Early Applicant
Melbourne, Victoria, AUS
In-Office
Entry level
Information Technology • Software • Consulting
The Role
Build, enhance, and maintain batch, streaming, and near-real-time data pipelines. Design reusable frameworks for ingestion, transformation, orchestration, and data quality. Develop ETL/ELT solutions using SQL and distributed processing, while implementing production-grade error handling, logging, monitoring, troubleshooting, and performance optimization.
Summary Generated by Built In

Must Have Skills: Kafka, API implementation, PostgreSQL, AWS


Nice to Have Skills: AWS certified

Detailed Job Description

Good communication skills with knowledge on Kafka, API implementation, PostgreSQL, AWS

•Strong understanding of SDLC process.

•Should have Strong understanding and trouble shooting skills

 

Core requirements:

 

  • Must have strong experience in building, enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near‑real‑time processing. 
  • Must be able to design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls. 
  • Must demonstrate proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing. 

Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization. 



Skills Required

  • Kafka experience
  • API implementation experience
  • PostgreSQL experience
  • AWS experience
  • Strong communication skills
  • Understanding of the software development life cycle
  • Strong troubleshooting skills
  • Experience building, enhancing, and maintaining batch, streaming, and near-real-time data pipelines
  • Ability to design reusable data engineering frameworks, accelerators, and templates
  • Proficiency in ETL/ELT development and SQL-based transformations
  • Experience with distributed data processing
  • Experience implementing production-grade pipelines with error handling, logging, monitoring, and performance optimization
  • AWS certification
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Melbourne
120 Employees
Year Founded: 2016

What We Do

XPT Software Australia Pty Ltd is a technology consulting and software services company serving clients across banking, financial services and insurance, telecommunications, mining, retail, energy, and manufacturing. It provides software development, IT management consulting, business analysis, project and program management, infrastructure support, and offshore development through onsite-offshore delivery. The company also works with cloud computing, big data, mobile applications, UI/UX, algorithms, and IoT.

Similar Jobs

Commonwealth Bank Logo Commonwealth Bank

Data Engineer

Fintech • Financial Services
In-Office
2 Locations
52000 Employees

Hilton Logo Hilton

Food & Beverage Attendant

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
Melbourne, Victoria, AUS
500000 Employees

Datadog Logo Datadog

Counsel

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Melbourne, Victoria, AUS
6500 Employees

Hilton Logo Hilton

Housekeeping Attendant

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
Melbourne, Victoria, AUS
500000 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account