Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Melbourne, Victoria, AUS
In-Office
Mid level
Fintech • Software • Financial Services
The Role
Design, build, and own cloud-based data pipelines and lakehouse infrastructure using Python, SQL, PySpark, dbt, and AWS. Ensure data quality, security, governance, compliance, performance, and reliability across production systems. Monitor and troubleshoot incidents, support API, streaming, and CDC ingestion, contribute to platform architecture, evaluate new technologies, mentor engineers, and lead technical projects in a regulated financial environment.
Summary Generated by Built In

Eightcap operates at the intersection of cutting-edge technology and global financial markets. Headquartered in Melbourne with a global footprint spanning the UK, Cyprus, and Bulgaria, we build the high-performance infrastructure that connects the world to CFD markets - reliably, securely and with precision.

We're looking for a data engineer who thinks like an owner, not just a builder. Someone who sees a pipeline not as a task to finish but as infrastructure to be trusted, and who wants to be the person the team turns to when data needs to be right, fast and secure. In this role, you'll own critical, regulated data pipelines end to end, and become a key technical voice shaping how our data platform grows.

To drive real impact in this role, you will:

  • Build the Data Backbone: Design, build and maintain end to end pipelines that bring internal, API, streaming and third-party data into our data lake.
  • Shape the Platform's Architecture: Contribute to the design of our data lake and lead complex pipeline components, backed by solid documentation.
  • Write Code That Lasts: Write and review high quality SQL and Python, using tools like PySpark, dbt and AWS Glue, EMR and S3, while raising the bar on team standards.
  • Own Data Quality and Compliance: Implement validation, cleansing, security and governance frameworks that keep our pipelines accurate, safe and aligned with obligations like ASIC reporting.
  • Keep Things Running: Monitor, troubleshoot and optimise pipelines for performance, cost and reliability, and jump in when production incidents need solving.
  • Grow the Team Around You: Mentor junior and mid-level engineers, contribute to code and design reviews, and lead delivery on your own technical projects.
  • Bring in What's Next: Evaluate new data sources and third-party APIs, and keep the team's tools and practices current with emerging tech.

Requirements
  • Minimum of 3 years’ experience as a Data Engineer, with demonstrable ownership of significant data pipelines or platform components.
  • Degree in Computer Science, Software Engineering, or related field.
  • Strong, hands-on proficiency in SQL and Python, with practical expertise in PySpark and modern data lake/lakehouse solutions.
  • Proven ability to design and build cloud-based data lake, warehouse, and lakehouse solutions, including complex ETL/ELT pipelines from multiple sources.
  • Deep experience with AWS services (Glue, Crawler, S3, EMR, RDS, DMS, Lambda, Batch, Athena, Redshift) to build data lake infrastructure; experienced in building and maintaining API-based, streaming, and CDC ingestion.
  • Strong track record of monitoring, troubleshooting, and optimizing AWS data pipelines across production and development environments.
  • Experience with transformation frameworks such as dbt and a solid understanding of data governance concepts.
  • Practical experience with DevOps and CI/CD practices.
  • Solid exposure to core AWS infrastructure, including IAM, VPC, VPC Peering, NAT Gateway, ACL, Secrets Manager, EC2, and ECS.
  • Clear communication skills, with the ability to explain technical concepts to both technical and non-technical audiences.
  • Interest in trading, FX, or general finance, with exposure to regulated data environments would be highly advantageous!

BenefitsWhat's it like to work at Eightcap?

We have built a performance-driven environment where you're given the autonomy to drive change and the accountability to own the results. We provide a space for the ambitious, adaptable and collaborative to deliver outcomes that fuel our success while building the skills and experience that defines a career.

We also support you through:

  • Ongoing investment in your career development, including technical and professional training.
  • Wellness and lifestyle perks, such as monthly corporate massages.
  • Drinks every Friday.
  • Parental leave entitlements.
  • Staff referral bonus programme.
  • Annual flu vaccinations.
  • Purchased leave.
  • Novated leasing options for vehicle financing and management.
  • A great CBD location with easy access to public transport.
  • A multicultural, collaborative and supportive team culture.
  • Being part of exciting new projects for the company.
  • Regular social activities.

Skills Required

  • Minimum 3 years of experience as a Data Engineer, including ownership of significant data pipelines or platform components.
  • Degree in Computer Science, Software Engineering, or a related field.
  • Strong hands-on proficiency in SQL and Python.
  • Practical expertise with PySpark and modern data lake or lakehouse solutions.
  • Experience designing and building cloud-based data lake, warehouse, and lakehouse solutions.
  • Experience building complex ETL and ELT pipelines from multiple sources.
  • Deep experience with AWS Glue, Glue Crawler, S3, EMR, RDS, DMS, Lambda, Batch, Athena, and Redshift.
  • Experience building and maintaining API-based, streaming, and CDC ingestion.
  • Experience monitoring, troubleshooting, and optimizing AWS data pipelines across production and development environments.
  • Experience with dbt or similar transformation frameworks.
  • Understanding of data governance concepts.
  • Practical experience with DevOps and CI/CD practices.
  • Exposure to AWS infrastructure including IAM, VPC, VPC Peering, NAT Gateway, ACL, Secrets Manager, EC2, and ECS.
  • Clear communication skills for technical and non-technical audiences.
  • Interest in trading, FX, or general finance.
  • Exposure to regulated data environments.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Melbourne, Victoria
264 Employees
Year Founded: 2009

What We Do

Based in Melbourne, we're engaging, educating and elevating traders, partners and exchanges through our portfolio of market-leading solutions. This account and content are not intended for UK residents or those within the European Economic Area.

Similar Jobs

Altis Consulting Logo Altis Consulting

Consultant

Information Technology • Software • Database • Analytics • Consulting
Hybrid
Melbourne, Victoria, AUS
197 Employees

Altis Consulting Logo Altis Consulting

Senior Consultant

Information Technology • Software • Database • Analytics • Consulting
Hybrid
Melbourne, Victoria, AUS
197 Employees

Xero Logo Xero

Senior Data Engineer

Cloud • Fintech • Information Technology • Machine Learning • Software
Hybrid
3 Locations
4500 Employees

Walmart Global Tech Logo Walmart Global Tech

Data Engineer

Big Data • Cloud • Logistics • Machine Learning • Retail
Remote or Hybrid
8 Locations
578950 Employees
110K-286K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account