Senior Data Engineer

Posted Yesterday
Be an Early Applicant
London, Greater London, England, GBR
In-Office
Senior level
Information Technology • Consulting • Pharmaceutical • Chemical
The Role
Lead the end-to-end migration of a legacy SQL Server/SSIS data platform into modern ELT pipelines using dbt. Implement Data Vault 2.0, build datamarts, design Dagster orchestration on OpenShift/Kubernetes, enable Kafka-triggered near-real-time flows, and establish data validation, automated testing, monitoring, and operational support in a regulated banking environment.
Summary Generated by Built In
The Opportunity

We are supporting a major data platform transformation within a banking environment, moving from a legacy SQL Server and SSIS-based setup to a modern, scalable architecture built on dbt, Dagster, and OpenShift.

This role is not about maintaining existing systems. It is about rebuilding a critical data platform from the ground up, with direct impact on risk, trading PnL, and core financial data flows.

We are looking for a hands-on Senior Data Engineer who can take ownership of complex migration workstreams and deliver reliably in a regulated, high-stakes environment.  

What You Will Do

You will play a central role in the end-to-end migration and modernisation of the data platform.

Platform Transformation

  • Translate legacy ETL logic from SSIS and stored procedures into modern ELT pipelines using dbt
  • Implement Data Vault 2.0 structures including Raw Vault and Business Vault
  • Build datamarts and curated datasets for downstream analytics and reporting


Orchestration & Infrastructure

  • Design and operate workflows using Dagster, including scheduling, dependencies, and recovery mechanisms
  • Deploy and run data workloads on OpenShift / Kubernetes environments


Event-Driven Data Processing

  • Enable near real-time data processing using Kafka-triggered pipelines
  • Integrate with upstream data lake environments and external data providers


Data Quality & Validation

  • Establish robust data validation and reconciliation processes
  • Implement automated testing and monitoring using dbt


Operational Ownership

  • Support production pipelines and resolve incidents when required
  • Create clear documentation and ensure operational readiness
  • Continuously improve performance, reliability, and maintainability
What You Will Do

You will play a central role in the end-to-end migration and modernisation of the data platform.


Platform Transformation

  • Translate legacy ETL logic from SSIS and stored procedures into modern ELT pipelines using dbt
  • Implement Data Vault 2.0 structures including Raw Vault and Business Vault
  • Build datamarts and curated datasets for downstream analytics and reporting


Orchestration & Infrastructure

  • Design and operate workflows using Dagster, including scheduling, dependencies, and recovery mechanisms
  • Deploy and run data workloads on OpenShift / Kubernetes environments


Event-Driven Data Processing

  • Enable near real-time data processing using Kafka-triggered pipelines
  • Integrate with upstream data lake environments and external data providers


Data Quality & Validation

  • Establish robust data validation and reconciliation processes
  • Implement automated testing and monitoring using dbt


Operational Ownership

  • Support production pipelines and resolve incidents when required
  • Create clear documentation and ensure operational readiness
  • Continuously improve performance, reliability, and maintainability

RequirementsWhat You Bring

Technical Expertise

  • Strong experience with SQL Server and T-SQL, including performance optimisation
  • Proven hands-on experience with dbt in production environments
  • Solid experience with workflow orchestration tools, ideally Dagster
  • Practical knowledge of Data Vault 2.0 modelling concepts
  • Experience working with container platforms such as OpenShift or Kubernetes
  • Familiarity with event-driven architectures and Kafka


Domain Experience

  • Experience working with financial data, ideally in banking or trading environments
  • Understanding of risk and PnL data structures is a strong advantage


Working Style

  • Strong ownership mindset with the ability to work independently
  • Structured, pragmatic, and delivery-focused
  • Comfortable operating in complex and regulated environments
  • Clear communicator across both technical and business stakeholders
What Success Looks Like

Within the first months, you will have:

  • Delivered initial Data Vault structures and migrated datasets into the new platform
  • Established stable, event-driven pipelines
  • Ensured data consistency and validation between legacy and new systems
  • Contributed to a production-ready, scalable data platform

Skills Required

  • Strong experience with SQL Server and T-SQL, including performance optimisation
  • Proven hands-on experience with dbt in production environments
  • Experience with workflow orchestration tools (ideally Dagster)
  • Practical knowledge of Data Vault 2.0 modelling concepts
  • Experience working with container platforms such as OpenShift or Kubernetes
  • Familiarity with event-driven architectures and Kafka
  • Experience working with financial data, ideally in banking or trading environments
  • Understanding of risk and PnL data structures (strong advantage)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sissach
66 Employees

What We Do

Avacone is a Swiss-based service provider specializing in IT infrastructure and pharmaceutical engineering, delivering specialized solutions for regulated and non-regulated environments in the pharmaceutical, chemical, and medical technology sectors.

Similar Jobs

Wise Logo Wise

Senior Data Engineer

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
London, Greater London, England, GBR
9000 Employees
111K-145K Annually

monday.com Logo monday.com

Senior Software Engineer

Artificial Intelligence • Productivity • Sales • Software
Hybrid
London, Greater London, England, GBR
3048 Employees

Standard Life Logo Standard Life

Senior Data Engineer

Insurance • Financial Services
Hybrid
3 Locations
2185 Employees
45K-65K Annually

n8n Logo n8n

Senior Data Engineer

Artificial Intelligence • Software • Automation
In-Office or Remote
27 Locations
61 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account