Data Engineering Manager

Posted Yesterday
Be an Early Applicant
Harbor Side, CA, USA
In-Office
Senior level
Financial Services
The Role
Lead and grow a team of data engineers to deliver production-grade, auditable data platforms and pipelines. Own end-to-end delivery, operations, monitoring, incident response, cost and performance optimisation, engineering standards, and regulatory compliance while partnering with product and modelling stakeholders.
Summary Generated by Built In
Excited to grow your career?

Our purpose is to make it easy for people to save and invest for a better future. We are looking for great people to join us, so please come and invest in YOUR future at Hargreaves Lansdown.

We know that sometimes people can be put off applying for a job if they don't tick every box. If you're excited about working for us and have most of the skills or experience we're looking for, please go ahead and apply. We’d love to hear from you!

About the role

Someone needs to make sure the engineering actually ships, reliably, at scale, and to a standard that holds up under regulatory scrutiny. That's this role.
You'll lead a team of data engineers, owning delivery end-to-end: pipelines, transformations, platform components, production operations, and the engineering practices that tie it all together. You'll set the bar for quality and ownership, manage cost and performance, and build a team culture where things are done properly, not just done.
This is hands-on leadership. You won't be writing every pipeline, but you'll know what good looks like, hold people to it, and clear the path so they can deliver. You'll operate in a regulated financial services environment where auditability, resilience, and governance aren't optional extras, they're the baseline.

What you'll be doing

  • Leading a team of data engineers - hiring, coaching, developing, and setting clear expectations for delivery quality and ownership
  • Owning end-to-end engineering delivery against the data product roadmap: pipelines that are idempotent, tested, observable, and documented
  • Running production operations - monitoring, incident response, root-cause analysis, and ensuring issues are resolved with clear ownership and learning
  • Defining and enforcing engineering standards across the team: coding conventions, testing strategy, CI/CD, code review, and documentation
  • Owning the cost and performance profile of data infrastructure - actively optimising compute, storage, and resource utilisation
  • Managing technical debt as a visible backlog item, not an invisible tax on delivery speed
  • Partnering with Data Product Managers on priorities and trade-offs, and with the Principal Data Modeller on data model standards
  • Ensuring engineering delivery meets regulatory, security, and governance requirements - auditable, recoverable, and secure by default

About you

  • 8+ years in data engineering or software engineering, with at least 2–3 years in people management
  • Proven experience delivering and operating production data platforms and pipelines at scale
  • Experience defining and enforcing engineering standards across a team
  • Strong operational mindset: reliability, monitoring, incident response, cost management
  • Hands-on with modern cloud data platforms (e.g. Snowflake, BigQuery, Redshift)
  • Experience with orchestration tools (e.g. Airflow, Dagster), CI/CD, and automated deployment
  • Confident influencing stakeholders and making delivery trade-offs with transparency
  • Comfortable delegating - accountable for outcomes, not personal code output
  • Demonstrated ability to build, grow, and retain high-performing engineering teams
  • Experience in a regulated environment (financial services, insurance, or banking)
  • Experience operating within a data product or platform operating model, not solely project-based delivery

Desirable

  • Experience with transformation frameworks (e.g. dbt)
  • Experience with streaming or event-driven architectures
  • Exposure to semantic layers, metrics layers, or feature engineering patterns
  • Experience managing platform costs and optimising spend at scale
  • Familiarity with data governance tooling (catalogues, lineage tools, quality frameworks)
  • Experience supporting AI/ML feature pipelines or model serving infrastructure

Interview process

Three stages: an initial screening call, followed by technical competency-based questions and a scenario task.

Working schedule

Based at our Bristol head office (BS1 5HL), 37.5 hours per week, Monday to Friday. We offer hybrid flexible working — a mix of office and home.

Why us?

Here at HL, we’re the UK’s number 1 investment platform for private investors, based in Bristol. For more than 40 years we’ve helped investors save time, tax and money on their investments.

To achieve our mission, we believe we have a workplace like no other, with constant learning, dynamic teams, and a great ethos. We're steered by core values that promote service, quality, innovation, and opportunity in everything we do.

What's on offer?

  • Discretionary annual bonus* and annual pay review 
  • 25 days* holiday plus bank holidays and 1-day additional Christmas closure 
  • Option to purchase an additional 5 days holiday**  
  • Flexible working options available, including hybrid working  
  • Enhanced parental leave 
  • Pension scheme up to 11% employer contribution 
  • Income Protection and Life insurance (4 x salary core level of cover)  
  • Private medical insurance* 
  • Health care cash plans - including optical, dental, and outpatient care 
  • Health screening programme
  • Help@hand - confidential support including mental health counselling and remote GP 
  • Wellhub - unlimited access to fitness providers and wellness coach sessions 
  • Variety of travel to work schemes with bike storage and shower facilities 
  • Inhouse barista and deli serving subsidised coffee and sandwiches 
  • Two paid volunteering days per year 

* dependant on role level 

** only available to select during our annual benefits window, in November each year 

Hargreaves Lansdown is an inclusive employer that values diversity in its workforce. We encourage applications from all individuals without regard to race, religion, gender, sexual orientation, national origin, disability or age.

This role may also be available on a flexible working or part time basis – please ask the Recruitment & Onboarding team for more information.

Please note, we are unable to provide employment sponsorship to candidates.

Skills Required

  • 8+ years in data engineering or software engineering, with at least 2-3 years in people management
  • Proven experience delivering and operating production data platforms and pipelines at scale
  • Experience defining and enforcing engineering standards across a team (coding conventions, testing, CI/CD, code review)
  • Strong operational mindset: reliability, monitoring, incident response, root-cause analysis, cost management
  • Hands-on with modern cloud data platforms (Snowflake, BigQuery, Redshift)
  • Experience with orchestration tools (Airflow, Dagster), CI/CD, and automated deployment
  • Confident influencing stakeholders and making delivery trade-offs with transparency
  • Comfortable delegating and accountable for team outcomes
  • Demonstrated ability to build, grow, and retain high-performing engineering teams
  • Experience in a regulated environment (financial services, insurance, or banking)
  • Experience operating within a data product or platform operating model
  • Experience with transformation frameworks (e.g., dbt)
  • Experience with streaming or event-driven architectures
  • Exposure to semantic layers, metrics layers, or feature engineering patterns
  • Experience managing platform costs and optimising spend at scale
  • Familiarity with data governance tooling (catalogues, lineage tools, quality frameworks)
  • Experience supporting AI/ML feature pipelines or model serving infrastructure
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Bristol
2,038 Employees
Year Founded: 1981

What We Do

We’re the UK’s number 1 investment platform for private investors, based in Bristol, where we now employ over 1,700 people. For more than 40 years we’ve helped investors save time, tax and money on their investments. Today we're trusted by over 1.7 million clients. Our service allows clients to bring all their ISAs, pensions, SIPPS, and savings into one easy to manage place, allowing them to be in control.

Similar Jobs

CrowdStrike Logo CrowdStrike

Data Engineering Manager

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
10000 Employees
125K-180K Annually

PwC Logo PwC

Tax Innovation & Delivery Experience - Data Engineering - Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
10 Locations
370000 Employees
99K-266K Annually

Airwallex Logo Airwallex

Engineering Manager

Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Hybrid
San Francisco, CA, USA
2200 Employees
200K-288K Annually

Headway Logo Headway

Senior Manager, Data Engineering

Consumer Web • Healthtech • Professional Services • Social Impact • Software
Hybrid
3 Locations
819 Employees
212K-265K Annually

Similar Companies Hiring

Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account