Lead Data Engineer - 12 Month FTC
Who We Are:
AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We’ve been helping organisations build better digital products and stronger digital teams since 2014.
We believe our work should always leave a legacy for the client. We do this through close relationships with our offices (or ‘Clubs’) so that our partners are always prioritised by a regional team close to them.
This unique model has driven success for our clients and ourselves, evidenced by our remarkable organic growth since 2014. Today we number more than 1,300 people with Clubs all over the UK and Europe with plans for global expansion in the next couple of years.
Join us - and help us fulfil our mission to close the world’s digital skills gap.
The Role
The Lead Data Engineer will play a key role in shaping, building and evolving the data capabilities that underpin our clients Accounts platform.
Working across data engineering, architecture and platform delivery, the role will provide technical leadership in the design and implementation of scalable, reliable and well-governed data solutions. This includes data pipelines, reference data services and operational data stores, ensuring that data is accurate, accessible, traceable and trusted across the wider ecosystem.
The successful candidate will combine strong hands-on data engineering expertise with the ability to lead technical direction, influence architecture decisions and establish engineering standards and best practices.
Key Responsibilities- Lead the design, development and ongoing evolution of robust, scalable data ingestion and processing pipelines.
- Provide technical leadership across ETL/ELT processes, data transformation and data integration services.
- Design and implement operational data stores and reference data services that support the Accounts platform and its consumers.
- Establish and maintain effective data quality, validation, monitoring, reconciliation and observability controls.
- Contribute to the evolution of data architecture, ensuring solutions are scalable, resilient, secure and aligned with wider technology strategy.
- Define and promote data engineering standards, patterns and best practices across the team.
- Support the development and implementation of data governance, lineage and data management practices.
- Work closely with software engineers, architects, product teams and other stakeholders to understand data requirements and translate them into effective technical solutions.
- Provide technical guidance and mentoring to other data engineers, helping to raise engineering capability and consistency across the team.
- Champion automation, Infrastructure as Code and modern engineering practices across the data landscape.
- Identify opportunities to improve the reliability, performance, maintainability and cost-effectiveness of data services and pipelines.
We're particularly interested in candidates with experience in:
- Strong SQL skills and extensive experience working with relational and/or modern database technologies.
- Proven commercial experience developing data solutions using Python.
- Strong understanding of modern data engineering principles, practices and design patterns.
- Experience designing and implementing ETL/ELT pipelines and data processing frameworks.
- Experience working with data quality, reconciliation, monitoring and operational data management.
- Experience contributing to data architecture and governance standards.
- Experience with Infrastructure as Code, ideally using Terraform.
- Experience working with cloud-based data platforms and modern engineering tooling.
- Experience leading technical delivery and making pragmatic architectural decisions in a complex technology environment.
Why join AND Digital?
We have three values: wonder, share, and delight. These values inform how we work with clients, and our culture: what it feels like to work for AND. We believe collaboration, ambition, curiosity and fun can drive innovation by creating a better environment for problem-solving.
By joining AND, we’ll provide:
- Opportunities to work on projects with big clients and the chance to produce meaningful work that makes a difference to people’s lives.
- A “Blended Working” model, meaning you will be able to work in a range of locations from; your home, in your clubhouse, on a client, as well as just a change of scenery.
- A dedicated career scrum team, designed to help you reach your career goals and develop the skills you need to be your best self.
- An annual budget for training and upskilling, including allocated days off so you don’t have to study in your own free time.
- Monthly and quarterly team socials - on us - ranging from after work drinks, to driving experience days with your fellow club members.
- A safe environment for you to be yourself and challenge yourself.
Equal Opportunities Statement
At AND Digital we embrace diversity and are committed to equal opportunities. We are actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application.
We want you to feel safe and empowered to let us know if you require any adjustments to be made to your application or interview process so please speak to our recruitment team.
Skills Required
- Strong SQL skills and extensive experience with relational and/or modern database technologies.
- Commercial experience developing data solutions using Python.
- Strong understanding of modern data engineering principles, practices and design patterns.
- Experience designing and implementing ETL/ELT pipelines and data processing frameworks.
- Experience with data quality, reconciliation, monitoring and operational data management.
- Experience contributing to data architecture and governance standards.
- Experience with Infrastructure as Code, ideally using Terraform.
- Experience working with cloud-based data platforms and modern engineering tooling.
- Experience leading technical delivery and making pragmatic architectural decisions in complex environments.
What We Do
AND Digital is on a mission to close the world’s digital skills gap. We do that by doing things differently when we work with our clients, communities and colleagues. Instead of working FOR exciting brands (like British Airways, Heineken and Nike), we work WITH them, and that's not just a party line. We combine our people with our clients' people to form a single project team, so collaborative you can't tell our ANDis from our clients. By working together, we help our partners understand and map out the challenges they're trying to solve. Then, by building their digital products as one team, we teach them the same digital skills we have. That means when we leave, they can own their apps, websites and future projects independently. Pretty cool huh? We have cross-functional teams working across the UK, Netherlands and East Coast US - and growing by demand. Our unique, city-based Club model means we can offer the agility and personalised service of a small local company, with the security and clout of a global organisation
.png){kind=logo}
