Data Engineering Manager

Posted 3 Days Ago
Be an Early Applicant
Harbor Side, CA, USA
In-Office
Senior level
Financial Services
The Role
Lead a team of data engineers responsible for building and operating reliable, scalable data pipelines and platform components. Own delivery, production operations, engineering standards, cost and performance optimization, technical debt, and regulatory compliance. Partner with product and data modeling leaders to deliver a governed data platform. Hire, coach, and develop engineers while ensuring strong practices in testing, monitoring, incident response, CI/CD, documentation, and secure infrastructure management.
Summary Generated by Built In
Excited to grow your career?

Our purpose is to make it easy for people to save and invest for a better future. We are looking for great people to join us, so please come and invest in YOUR future at Hargreaves Lansdown.

We know that sometimes people can be put off applying for a job if they don't tick every box. If you're excited about working for us and have most of the skills or experience we're looking for, please go ahead and apply. We’d love to hear from you!

About the role

Someone needs to make sure the engineering actually ships, reliably, at scale, and to a standard that holds up under regulatory scrutiny. That's this role.
You'll lead a team of data engineers, owning delivery end-to-end: pipelines, transformations, platform components, production operations, and the engineering practices that tie it all together. You'll set the bar for quality and ownership, manage cost and performance, and build a team culture where things are done properly, not just done.
This is hands-on leadership. You won't be writing every pipeline, but you'll know what good looks like, hold people to it, and clear the path so they can deliver. You'll operate in a regulated financial services environment where auditability, resilience, and governance aren't optional extras, they're the baseline.

What you'll be doing

  • Leading a team of data engineers - hiring, coaching, developing, and setting clear expectations for delivery quality and ownership
  • Owning end-to-end engineering delivery against the data product roadmap: pipelines that are idempotent, tested, observable, and documented
  • Running production operations - monitoring, incident response, root-cause analysis, and ensuring issues are resolved with clear ownership and learning
  • Defining and enforcing engineering standards across the team: coding conventions, testing strategy, CI/CD, code review, and documentation
  • Owning the cost and performance profile of data infrastructure - actively optimising compute, storage, and resource utilisation
  • Managing technical debt as a visible backlog item, not an invisible tax on delivery speed
  • Partnering with Data Product Managers on priorities and trade-offs, and with the Principal Data Modeller on data model standards
  • Ensuring engineering delivery meets regulatory, security, and governance requirements - auditable, recoverable, and secure by default

About you

  • 8+ years in data engineering or software engineering, with at least 2–3 years in people management
  • Proven experience delivering and operating production data platforms and pipelines at scale
  • Experience defining and enforcing engineering standards across a team
  • Strong operational mindset: reliability, monitoring, incident response, cost management
  • Hands-on with modern cloud data platforms (e.g. Snowflake, BigQuery, Redshift)
  • Experience with orchestration tools (e.g. Airflow, Dagster), CI/CD, and automated deployment
  • Confident influencing stakeholders and making delivery trade-offs with transparency
  • Comfortable delegating - accountable for outcomes, not personal code output
  • Demonstrated ability to build, grow, and retain high-performing engineering teams
  • Experience in a regulated environment (financial services, insurance, or banking)
  • Experience operating within a data product or platform operating model, not solely project-based delivery

Desirable

  • Experience with transformation frameworks (e.g. dbt)
  • Experience with streaming or event-driven architectures
  • Exposure to semantic layers, metrics layers, or feature engineering patterns
  • Experience managing platform costs and optimising spend at scale
  • Familiarity with data governance tooling (catalogues, lineage tools, quality frameworks)
  • Experience supporting AI/ML feature pipelines or model serving infrastructure

Interview process

Three stages: an initial screening call, followed by technical competency-based questions and a scenario task.

Working schedule

Based at our Bristol head office (BS1 5HL), 37.5 hours per week, Monday to Friday. We offer hybrid flexible working — a mix of office and home.

Why us?

Here at HL, we’re the UK’s number 1 investment platform for private investors, based in Bristol. For more than 40 years we’ve helped investors save time, tax and money on their investments.

To achieve our mission, we believe we have a workplace like no other, with constant learning, dynamic teams, and a great ethos. We're steered by core values that promote service, quality, innovation, and opportunity in everything we do.

What's on offer?

  • Discretionary annual bonus* and annual pay review 
  • 25 days* holiday plus bank holidays and 1-day additional Christmas closure 
  • Option to purchase an additional 5 days holiday**  
  • Flexible working options available, including hybrid working  
  • Enhanced parental leave 
  • Pension scheme up to 11% employer contribution 
  • Income Protection and Life insurance (4 x salary core level of cover)  
  • Private medical insurance* 
  • Health care cash plans - including optical, dental, and outpatient care 
  • Health screening programme
  • Help@hand - confidential support including mental health counselling and remote GP 
  • Wellhub - unlimited access to fitness providers and wellness coach sessions 
  • Variety of travel to work schemes with bike storage and shower facilities 
  • Inhouse barista and deli serving subsidised coffee and sandwiches 
  • Two paid volunteering days per year 

* dependant on role level 

** only available to select during our annual benefits window, in November each year 

​

Hargreaves Lansdown is an inclusive employer that values diversity in its workforce. We encourage applications from all individuals without regard to race, religion, gender, sexual orientation, national origin, disability or age.

This role may also be available on a flexible working or part time basis – please ask the Recruitment & Onboarding team for more information.

Please note, we are unable to provide employment sponsorship to candidates.

Skills Required

  • 8+ years of experience in data engineering or software engineering
  • 2-3 years of people management experience
  • Experience delivering and operating production data platforms and pipelines at scale
  • Experience defining and enforcing engineering standards across a team
  • Strong operational mindset including reliability, monitoring, incident response, and cost management
  • Hands-on experience with modern cloud data platforms such as Snowflake, BigQuery, or Redshift
  • Experience with orchestration tools such as Airflow or Dagster
  • Experience with CI/CD and automated deployment
  • Ability to influence stakeholders and make transparent delivery trade-offs
  • Ability to delegate and remain accountable for outcomes
  • Demonstrated ability to build, grow, and retain high-performing engineering teams
  • Experience in a regulated environment such as financial services, insurance, or banking
  • Experience working within a data product or platform operating model
  • Experience with transformation frameworks such as dbt
  • Experience with streaming or event-driven architectures
  • Exposure to semantic layers, metrics layers, or feature engineering patterns
  • Experience managing platform costs and optimizing spend at scale
  • Familiarity with data governance tooling, catalogs, lineage tools, or quality frameworks
  • Experience supporting AI/ML feature pipelines or model serving infrastructure
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Bristol
2,038 Employees
Year Founded: 1981

What We Do

We’re the UK’s number 1 investment platform for private investors, based in Bristol, where we now employ over 1,700 people. For more than 40 years we’ve helped investors save time, tax and money on their investments. Today we're trusted by over 1.7 million clients. Our service allows clients to bring all their ISAs, pensions, SIPPS, and savings into one easy to manage place, allowing them to be in control.

Similar Jobs

Applied Systems Logo Applied Systems

Sr. Manager, Data Engineering

Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Remote or Hybrid
United States
3116 Employees
135K-185K Annually

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Software Engineering Manager

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
Sunnyvale, CA, USA
85422 Employees
136K-275K Annually
In-Office or Remote
2 Locations
132624 Employees
Remote or Hybrid
United States
441 Employees
165K-200K Annually

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account