Lead Data Solution Engineer

Posted 9 Days Ago
Be an Early Applicant
Birmingham, West Midlands, England, GBR
In-Office
Senior level
Information Technology • Consulting
The Role
Lead Data Solution Engineer designs, builds and operates production-grade data pipelines and platforms (cloud and on-prem) with strong Databricks expertise. Responsibilities include data modelling, DataOps (CI/CD, IaC, version control), orchestration (dbt/Airflow/Prefect/Dagster), cloud platform deployments/migrations, and translating stakeholder needs into trustworthy data products.
Summary Generated by Built In

About Us

We’re on a mission to close the world’s tech skills gap. 

We help organisations navigate the future of technology, combining human expertise, emerging tech and AI to deliver better outcomes, faster.

Since 2014, we’ve worked side-by-side with clients to solve complex challenges, build high-performing teams, and create lasting capability. As technology continues to evolve, we believe the most successful organisations will be those that combine the best of both: human ingenuity AND intelligent technology.

That belief is embedded in everything we do. We call it the genius of the AND: deep expertise AND practical delivery, innovation AND responsibility, ambitious work AND sustainable careers.

Through our Guide, Build and Equip approach, we help organisations embrace change, deliver meaningful impact, and develop the skills they need to thrive in an increasingly agentic world.

About you:

  • You care deeply about producing high-quality work that delivers real value
  • You’re comfortable navigating ambiguity and solving complex problems collaboratively
  • You bring strong expertise in your craft, alongside a willingness to keep learning
  • You communicate clearly and build trust quickly with clients and teammates
  • You’re pragmatic, adaptable and outcome-focused
  • You enjoy sharing knowledge and helping others grow
  • You value low-ego collaboration and enjoy working as part of multidisciplinary teams

As a Lead Data Solution Engineer, you’ll help our clients deploy and maintain data pipelines in a production-safe manner, using the latest technologies and with a DataOps culture. You’ll work in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data solutions to clients of different sizes and from various sectors.

Your responsibilities: 

  • Develop pipelines that bring data to life for decision-making, either delivering insight or for more sophisticated AI & machine learning applications
  • Experience in being hands on with data, applying the practicalities of quality, flow, and organisation of information, and an understanding of data modelling approaches.
  • Be comfortable working in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms for different-size organisations.
  • Practical hands-on experience of designing, architecting & deploying AI-enabled solutions at least one cloud data platform (e.g. Databricks, Snowflake, AWS, Azure or GCP) and experience of associated technologies (for example with AWS: DynamoDB, Redshift, Kinesis Pipelines, Glue, Lambda, QuickSight, etc) ideally including practical/hands-on experience of migration to or adoption of a cloud data platform.
  • Strong Databricks expertise is a must (ideally with appropriate certifications) with Snowflake and/or MS Fabric experience a bonus.
  • Previous practical experience of using both SQL and task orchestration software (eg. dbt, Airflow/Prefect/Dagster or equivalent) to develop production-grade pipelines that bring data to life.
  • Hands-on DataOps experience (eg. CI/CD, version control, IaC, etc.)
  • Have experience adopting a Data Product mindset, ensuring datasets are discoverable, addressable, trustworthy, and self-describing for downstream consumers.
  • Ability to bridge the gap between technical engineering and business value, translating stakeholder needs into robust data product specifications.

Interview Process

We are committed to making the recruitment process as smooth and as hassle free as possible. This is the approach we take:

  • Initial screening call with recruitment (30 mins)
  • Short home-prep case study
  • In-person technical interview (1-1.5 hours)
  • Cultural interview (45 mins)

Why join AND Digital?

We’re building a culture where talented people can do meaningful work, continue growing, AND enjoy the journey along the way.

Our model is designed to build belonging and connection: we’re organised into regional ‘Clubs’ of no more than 80 people, so you (and our clients) get the benefits of that small company feel while also being connected to a larger whole.

Our Practice Areas act as a ‘second home’ for our ANDis - a place where you can innovate and learn with like-minded experts who care deeply about their craft, support each other generously, and believe the best ideas come from collaboration, not hierarchy.

Our culture is rooted in our values of Wonder, Share and Delight, and shows up through five traits that we celebrate and nurture in all our ANDis: we value curiosity, ambition and a growth-mindset. We are deeply client-centric. Most important of all we are human - we create an inclusive environment where people feel trusted, supported and able to be themselves.

By joining AND, we’ll provide:

  • 25 days bookable holiday + flexible Bank Holidays 
  • Pension: 6% of salary paid by AND Digital with a further 2% paid by you (can be increased by choice).
  • Aviva healthcare cover (including pre-existing condition cover) for you.
  • Flexibenefit: £1000 assigned to you via our benefits portal to select or upgrade the benefits that suit you the most. Any unused allowance from the £1000 can be taken as cash. 
  • Life Assurance.
  • Income Protection.
  • Eye test + first pair of glasses.
  • Parental Benefits: Generous Enhanced Maternity and Enhanced Partner (Paternity) Leave.

Equal Opportunities Statement

Diversity and inclusion are hugely important to us, and we’re committed to providing equal opportunities for all. We’re actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application.

We want you to feel safe and empowered to let us know if you need any adjustments to be made to your application or interview process, so please speak to our recruitment team.

AI Statement

We champion tech that helps people work smarter, but we want to get to know you! If you use AI to assist with your application or interview prep, please ensure all information submitted remains an accurate, truthful representation of your personal achievements and capabilities rather than generating false or misleading information. We may reject applications where AI is used inappropriately at any stage of the recruitment process.

Skills Required

  • Strong Databricks expertise (certification ideally)
  • Practical experience designing, architecting, and deploying AI-enabled solutions on at least one cloud data platform (Databricks, Snowflake, AWS, Azure, GCP)
  • Hands-on experience with associated cloud technologies (examples: DynamoDB, Redshift, Kinesis, Glue, Lambda, QuickSight)
  • Proven use of SQL and task orchestration tools (dbt, Airflow, Prefect, Dagster or equivalent) to build production-grade pipelines
  • Hands-on DataOps experience including CI/CD, version control and Infrastructure as Code
  • Experience adopting a Data Product mindset (discoverable, addressable, trustworthy, self-describing datasets)
  • Ability to translate stakeholder needs into robust data product specifications and bridge technical/business value
  • Practical experience of migration to or adoption of a cloud data platform
  • Experience working in fast-moving, agile, multidisciplinary teams
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Covent Garden
1,348 Employees
Year Founded: 2014

What We Do

AND Digital is on a mission to close the world’s digital skills gap. We do that by doing things differently when we work with our clients, communities and colleagues. Instead of working FOR exciting brands (like British Airways, Heineken and Nike), we work WITH them, and that's not just a party line. We combine our people with our clients' people to form a single project team, so collaborative you can't tell our ANDis from our clients. By working together, we help our partners understand and map out the challenges they're trying to solve. Then, by building their digital products as one team, we teach them the same digital skills we have. That means when we leave, they can own their apps, websites and future projects independently. Pretty cool huh? We have cross-functional teams working across the UK, Netherlands and East Coast US - and growing by demand. Our unique, city-based Club model means we can offer the agility and personalised service of a small local company, with the security and clout of a global organisation

Similar Jobs

Morningstar Logo Morningstar

Quantitative Analyst, New Product Development

Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
Hybrid
London, Greater London, England, GBR
11500 Employees
72K-100K Annually

NBCUniversal Logo NBCUniversal

Human Resources Manager

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
Brentford, Middlesex, England, GBR

NBCUniversal Logo NBCUniversal

Human Resources Coordinator

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
Brentford, Middlesex, England, GBR

Atlassian Logo Atlassian

Solutions Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
London, Greater London, England, GBR
11000 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account