Lead Data Engineer

Reposted 24 Days Ago
Be an Early Applicant
Birmingham, West Midlands, England, GBR
In-Office
Senior level
Information Technology • Consulting
The Role
The Lead Data Engineer is responsible for developing and maintaining data pipelines, ensuring data quality, and working within multi-disciplinary teams to deliver data platforms in an agile environment.
Summary Generated by Built In

Who We Are:
We’re on a mission to close the world’s tech skills gap. 

We help organisations navigate the future of technology, combining human expertise, emerging tech and AI to deliver better outcomes, faster.

Since 2014, we’ve worked side-by-side with clients to solve complex challenges, build high-performing teams, and create lasting capability. As technology continues to evolve, we believe the most successful organisations will be those that combine the best of both: human ingenuity AND intelligent technology.

That belief is embedded in everything we do. We call it the genius of the AND: deep expertise AND practical delivery, innovation AND responsibility, ambitious work AND sustainable careers.

Through our Guide, Build and Equip approach, we help organisations embrace change, deliver meaningful impact, and develop the skills they need to thrive in an increasingly agentic world.

About you:

  • You care deeply about producing high-quality work that delivers real value
  • You’re comfortable navigating ambiguity and solving complex problems collaboratively
  • You bring strong expertise in your craft, alongside a willingness to keep learning
  • You communicate clearly and build trust quickly with clients and teammates
  • You’re pragmatic, adaptable and outcome-focused
  • You enjoy sharing knowledge and helping others grow
  • You value low-ego collaboration and enjoy working as part of multidisciplinary teams

What you’ll bring to the table:

As a Lead Data Engineer, you’ll help our clients deploy and maintain data pipelines in a production-safe manner, using the latest technologies and with a DataOps culture. You’ll work in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.

Your responsibilities:

  • Develop pipelines that brings data to life for decision making, either delivering insight or for more sophisticated data science applications
  • Experience in being hands on with data, applying the practicalities of quality, flow, and organisation of information, and an understanding of data modelling approaches.
  • Be comfortable working in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.
  • Previous practical experience of using both SQL and task orchestration software (eg. dbt, Airflow/Prefect/Dagster or equivalent) to develop production-grade pipelines that bring data to life
  • Strong Snowflake experience is preferred, and Databricks experience would be a bonus
  • Practical hands-on experience of at least one cloud platform (AWS, Azure or GCP) and experience of associated technologies (for example with AWS: DynamoDB, Redshift, Kinesis Pipelines, Glue, Lambda, QuickSight, etc)
  • Hands-on dataops experience (eg. CI/CD, version control, IaC, etc.)
  • Have experience adopting a Data Product mindset, ensuring datasets are discoverable, addressable, trustworthy, and self-describing for downstream consumers.
  • Ability to bridge the gap between technical engineering and business value, translating stakeholder needs into robust data product specifications.

Why join AND Digital?

We’re building a culture where talented people can do meaningful work, continue growing, AND enjoy the journey along the way.

Our model is designed to build belonging and connection: we’re organised into regional ‘Clubs’ of no more than 80 people, so you (and our clients) get the benefits of that small company feel while also being connected to a larger whole.

Our Practice Areas act as a ‘second home’ for our ANDis - a place where you can innovate and learn with like-minded experts who care deeply about their craft, support each other generously, and believe the best ideas come from collaboration, not hierarchy.

Our culture is rooted in our values of Wonder, Share and Delight, and shows up through five traits that we celebrate and nurture in all our ANDis: we value curiosity, ambition and a growth-mindset. We are deeply client-centric. Most important of all we are human - we create an inclusive environment where people feel trusted, supported and able to be themselves.

By joining AND, we’ll provide:

  • 25 days bookable holiday + flexible Bank Holidays 
  • Pension: 6% of salary paid by AND Digital with a further 2% paid by you (can be increased by choice).
  • Aviva healthcare cover (including pre-existing condition cover) for you.
  • Flexibenefit: £1000 assigned to you via our benefits portal to select or upgrade the benefits that suit you the most. Any unused allowance from the £1000 can be taken as cash. 
  • Life Assurance.
  • Income Protection.
  • Eye test + first pair of glasses.
  • Parental Benefits: Generous Enhanced Maternity and Enhanced Partner (Paternity) Leave.

Equal Opportunities Statement

Diversity and inclusion are hugely important to us, and we’re committed to providing equal opportunities for all. We’re actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application.

We want you to feel safe and empowered to let us know if you need any adjustments to be made to your application or interview process, so please speak to our recruitment team.

Skills Required

  • Experience in developing data pipelines and data modeling
  • Hands-on experience with SQL and task orchestration software
  • Strong experience with Snowflake and Databricks
  • Hands-on experience with a cloud platform (AWS, Azure or GCP)
  • Experience with DataOps practices and CI/CD
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Edinburgh
1,348 Employees
Year Founded: 2014

What We Do

AND Digital is on a mission to close the world’s digital skills gap. We do that by doing things differently when we work with our clients, communities and colleagues. Instead of working FOR exciting brands (like British Airways, Heineken and Nike), we work WITH them, and that's not just a party line. We combine our people with our clients' people to form a single project team, so collaborative you can't tell our ANDis from our clients. By working together, we help our partners understand and map out the challenges they're trying to solve. Then, by building their digital products as one team, we teach them the same digital skills we have. That means when we leave, they can own their apps, websites and future projects independently. Pretty cool huh? We have cross-functional teams working across the UK, Netherlands and East Coast US - and growing by demand. Our unique, city-based Club model means we can offer the agility and personalised service of a small local company, with the security and clout of a global organisation

Similar Jobs

Liberis Logo Liberis

Lead Data Engineer

Financial Services
In-Office
London, Greater London, England, GBR
216 Employees
Hybrid
Cambridge, Cambridgeshire, England, GBR
14000 Employees

Ticketmaster Logo Ticketmaster

Platform Engineer

Events • News + Entertainment
In-Office or Remote
Home of the Gilders, Gildersome, Leeds, England, GBR
3850 Employees

CFC Logo CFC

Lead Data Engineer

Insurance • Cybersecurity
Hybrid
London, England, GBR

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account