Senior Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Sydney, New South Wales, AUS
In-Office
Senior level
Fintech • Quantitative Trading
The Role
Design and deliver governed, production-grade data products and a unified semantic layer across Finance, People, Procurement, and Compliance. Build scalable pipelines, models, and governance (Unity Catalog, DataHub, Delta) using Databricks, dbt, SQL, and PySpark. Drive data quality, lineage, access control, and enable analytics and AI consumers.
Summary Generated by Built In

Every major business function, including Finance, People, Procurement, Tax, and Compliance, operates on its own version of the truth: fragmented, siloed, and manually managed. You'll build the governed data foundation that replaces this, greenfield, on a modern stack, with real architectural ownership and production delivery in your hands.

The Problem You're Solving

One truth across multiple domains. Multiple business functions. Multiple definitions of the same metrics. Your role is designing and building the unified semantic layer that brings this together. This is a real modelling challenge where getting the business logic right matters as much as getting the code right.

Governance that's engineered, not bolted on. Lineage, access control, column masking, PII classification, and data stewardship are designed into every domain from day one using Unity Catalog and DataHub. The goal is a governance model rigorous enough to hold up to regulatory scrutiny and trusted enough that business teams stop building their own extracts.

The data layer that AI depends on. Optiver is building conversational analytics and AI agents that query business data through a semantic layer. What Databricks Genie surfaces to the business depends entirely on what you build underneath it.

What you'll do

  • Architect and own delivery of shared data products across Finance, People, Procurement, and Compliance, from design decisions through to production

  • Build and evolve the semantic layer that powers reporting, self-service analytics, conversational analytics, and Databricks Genie, writing the models, tests, and documentation that make it trustworthy

  • Design and build scalable data pipelines, data models, and governed data products using Databricks, dbt, SQL, and PySpark

  • Implement governance capabilities end-to-end, including Unity Catalog access controls, column-level security, data classification, lineage, and data quality standards

  • Drive DataHub adoption by defining metadata standards, lineage definitions, and data ownership models that make discoverability a first-class engineering concern

  • Translate complex and ambiguous requirements from senior stakeholders into production-grade data solutions, owning the problem from conversation to deployed model

  • Set the engineering standard for the team through the quality of your code, architecture decisions, and pull request reviews

  • Partner with the broader data team to continuously improve CI/CD, testing frameworks, observability, and data quality practices


Who you are

  • 8+ years of experience designing and building production data solutions, with a track record of leading complex technical initiatives end-to-end.

  • Track record of architectural ownership and designing end-to-end data solutions

  • Expert-level SQL and data transformation skills, with strong hands-on experience in dbt, PySpark, or both. You design data products for scale, write tests without friction, and have clear opinions on where each tool's limits are

  • Deep experience with Databricks, Lakehouse architectures, or comparable modern data technologies, including Delta table design, Unity Catalog governance, compute trade-offs, and downstream BI or AI workloads

  • Experience implementing governance at scale, including access control, PII handling, column-level security, data lineage, and data quality management in production environments

  • Experience building trusted business-facing data products within Finance, People/HR, Procurement, Operations, or similar domains. You understand business logic well enough to challenge unclear or incorrect requirements


Why This Is Challenging

You'll join a team building the foundations of how Optiver understands and operates its business. The data products you build will be used by business teams, leadership, and increasingly by AI-powered tools and conversational analytics experiences.

You'll work across a broad range of domains, from People and Finance to Procurement and Compliance, gaining exposure to how a global trading firm operates while building solutions on a modern stack that includes Databricks, dbt, Unity Catalog, DataHub, and Databricks Genie.

No prior trading or financial experience is needed – our onboarding program will kick-start your career at Optiver and support you in gaining all the relevant knowledge about our business.

Who we are
At Optiver, our mission is to constantly improve the market by injecting liquidity, providing accurate pricing, increasing transparency and acting as a stabilizing force no matter the market conditions. With a focus on continuous improvement, we participate in the safeguarding of healthy and efficient markets for everyone who participates. As one of the largest market making institutions, we are a trusted partner of 70+ exchanges across the globe.

What you'll get
You’ll join a culture of collaboration and excellence, where you’ll be surrounded by curious thinkers and creative problem solvers. Motivated by a passion for continuous improvement, you’ll thrive in a supportive, high-performing environment alongside talented colleagues, working collectively to tackle the toughest problems in the financial markets.
In addition, you’ll receive:


  • A performance-based bonus structure unmatched anywhere in the industry. We combine our profits across desks, teams and offices into a global profit pool, fostering a truly collaborative environment.

  • The chance to work alongside diverse and intelligent peers in a rewarding environment.

  • Training, mentorship and personal development opportunities.

  • Daily breakfast, lunch and an in-house barista.

  • Gym membership plus weekly in-house chair massages.

  • Regular social events, including a company trip every two years.

  • Guided relocation, a competitive relocation package and visa sponsorship where necessary.



Optiver is committed to diversity and inclusion. We encourage applications from candidates of all backgrounds, and welcome requests for reasonable adjustments during the process.

Questions? Get in touch with the recruitment team at [email protected]


Skills Required

  • 8+ years designing and building production data solutions with end-to-end ownership
  • Expert-level SQL and data transformation skills
  • Hands-on experience with dbt and/or PySpark
  • Deep experience with Databricks and Lakehouse architectures, including Delta table design
  • Experience implementing governance at scale: Unity Catalog access controls, column-level security, PII handling, lineage, and data quality
  • Experience driving metadata and lineage standards and adoption (DataHub or similar)
  • Proven track record of architectural ownership and delivering complex technical initiatives end-to-end
  • Experience building business-facing data products for Finance, HR/People, Procurement, or Operations domains
  • Experience with CI/CD, testing frameworks, observability, and data quality best practices
  • Familiarity with conversational analytics / Databricks Genie and AI-facing semantic layers

Optiver Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Optiver and has not been reviewed or approved by Optiver.

  • Career-Linked Recognition & Rewards Pay is considered highly competitive in trading, quantitative, and engineering paths, with performance-linked bonuses that materially elevate total compensation. High performers receive differentiated rewards tied to impact.
  • Leave & Time Off Breadth Generous paid vacation alongside market holidays is a consistent component of the U.S. package. This breadth of leave is a notable element of the offering.
  • Healthcare Strength Comprehensive health coverage—including medical, dental, and vision—is prominently offered in U.S. roles, with indications that employee premiums are fully covered in some cases. Disability and life coverage further strengthen the core health benefits.

Optiver Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Amsterdam
1,600 Employees
Year Founded: 1986

What We Do

Optiver’s story began over 30 years ago, when we started business as a single trader on the floor of Amsterdam’s options exchange. Today, we are at the forefront of trading and technology as a leading global electronic market maker, focused on pricing, execution and risk management.

Why Work With Us

People at Optiver love challenges, welcome collaboration, and strive to be better tomorrow than they are today. Improving the market is an extraordinary challenge that requires a carefully crafted approach. Optiver provides a collaborative working environment to tackle these challenges. In fact, it is this way of working that sets us apart.

Gallery

Gallery

Similar Jobs

CoStar Group Logo CoStar Group

Senior Data Engineer

Information Technology • Real Estate • Analytics
In-Office
Sydney, New South Wales, AUS
6500 Employees

TMGM Logo TMGM

Senior Data Engineer

Fintech • Financial Services
In-Office
Sydney, New South Wales, AUS
500 Employees

Billigence Logo Billigence

Senior Data Engineer

Information Technology • Consulting
In-Office
North Sydney, Sydney, New South Wales, AUS
198 Employees

Sime Logo Sime

Senior Data Engineer

Financial Services
In-Office or Remote
3 Locations
60 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account