Lead Data Engineer

Posted 22 Days Ago
Be an Early Applicant
Amsterdam
In-Office
Senior level
Fintech • Information Technology • Software • Financial Services
The Role
The Lead Data Engineer will manage the data engineering team, optimizing data architectures and ensuring high-quality data delivery for trading systems.
Summary Generated by Built In

We are looking for a Lead Data Engineer to shape and grow our performance-focused data engineering team. In this role, you’ll be responsible for defining the roadmap, setting best practices, and delivering high-quality infrastructure and tools that empower our traders, quant traders, and technology teams with accurate, fast, and accessible data.

You will take end-to-end ownership of all data, pipelines, and streams outside of TBricks, ensuring availability, quality, and governance. This includes managing vendor relationships, optimizing costs, and ensuring consistent, linked, and compliant data delivery to our trading and BI systems.

We’re actively evolving a stack with significant legacy components (e.g., MSSQL, SSIS/SSRS, MongoDB, InfluxDB) alongside modern technologies we are already building on (PostgreSQL, RedPanda/Kafka, KX/kdb+, Scylla, KeyDB, Kubernetes). Experience managing and migrating legacy systems to modern, scalable architectures, while successfully decommissioning outdated systems, is highly valuable.

You will lead by example, both technically and strategically, combining your DevOps, cloud, and hardware knowledge with a strong understanding of trading environments. You’ll monitor and continuously optimize inflow and query performance, proactively detect and resolve errors, and ensure access rights are managed in line with licensing, regulation, and safe practices—without creating unnecessary barriers.

Key Responsibilities:

  • Build and lead a high-performing data engineering team focused on delivering real-time, high-throughput, low-latency systems
  • Design, implement, and maintain scalable, performant data architectures, schemas, and pipelines
  • Monitor data presence, reliability, and quality, including automated error detection and prevention of duplicates or erroneous entries
  • Manage data vendors, optimize costs, and ensure seamless integration of external data with internal systems
  • Govern access rights in compliance with licensing, regulation, and security best practices
  • Integrate or replace existing legacy systems with modern, unified platforms and fully phase out deprecated technologies
  • Maintain a minimal yet sufficient set of core technologies while staying aware of emerging tools and industry trends
  • Provide standardized APIs and guidance to business users, enabling effective data consumption across the company
  • Collaborate with DevOps and IT Infrastructure to ensure the right compute resources and Kubernetes clusters are available, with auto-scaling and proactive alerts
  • Translate trading and business needs into a robust, forward-looking data strategy and roadmap
  • Foster a culture of ownership, collaboration, and continuous improvement

Key Requirements:

  • Deep experience building and scaling data platforms in performance-critical environments
  • Hands-on experience with some of the following technologies:
    • PostgreSQL, RedPanda/Kafka, KX/kdb+, Scylla, KeyDB
    • Kubernetes, containerization, and cloud/hybrid deployments
  • Proven experience migrating and decommissioning legacy systems in favour of modern architectures
  • Strong understanding of distributed systems, real-time data processing, and network performance optimization
  • DevOps and hardware infrastructure knowledge, especially in performance-sensitive systems
  • Demonstrated leadership skills—able to hire, coach, and inspire a team of data engineers
  • Strategic thinker with hands-on execution ability; ready to define vision and roll up your sleeves
  • Prior experience in trading or financial markets is an advantage

Why Join All Options?

At All Options, we offer a dynamic role with room for professional development and collaboration. Enjoy a competitive salary, bonus opportunities, profit sharing, 29 vacation days, and perks like a well-being allowance and in-house meals. Celebrate success with monthly drinks and festivities, and take advantage of our bicycle plan and an NS Business Card.


Apply Now!

If this sounds like your next challenge, submit your CV and cover letter. Our interview process ensures we find the right fit—and if it’s a match, we can’t wait to welcome you to the team!

Top Skills

Influxdb
Kafka
Kdb+
Keydb
Kubernetes
Kx
MongoDB
Mssql
Postgres
Redpanda
Scylla
Ssis
Ssrs
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Amsterdam
708 Employees
Year Founded: 1998

What We Do

‍Established in 1998, we're a fully regulated proprietary trading firm that thrives as a liquidity provider (market maker) on Europe's most prominent option exchanges. With our base in Amsterdam and our recently opened office in Austin, Texas, we're on a mission to leverage our expertise and scale our success by implementing proven trading strategies in the world's largest financial market, the USA. This offers you an exciting opportunity to be part of our expansion journey.

Joining All Options means becoming a highly skilled (quantitative) options trader, as we're committed to assembling a team of top-tier talent armed with the most innovative ideas. Our true strength lies not just in what we do, but in how we collaborate and grow together, making every moment at All Options stimulating and profoundly rewarding.

We firmly believe that our team members should consistently feel both challenged and supported. That's why we encourage employees not only to take ownership of their work but also to step boldly out of their comfort zones. As we're dedicated to your success, we provide all the tools, resources, and mentorship needed to help you thrive.

Similar Jobs

Adevinta Logo Adevinta

Lead Data Engineer

eCommerce • Marketing Tech
In-Office
Amsterdam, NLD

Mimica Logo Mimica

Python Engineer

Artificial Intelligence • Software • Automation
In-Office
8 Locations

Mimica Logo Mimica

Lead Full-stack Engineer

Artificial Intelligence • Software • Automation
In-Office
9 Locations

Devoteam Logo Devoteam

Data Engineer

Consulting • Cybersecurity
In-Office
Amsterdam, NLD

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Rain Thumbnail
Web3 • Payments • Infrastructure as a Service (IaaS) • Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
40 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account