Intermediate Data Engineer

Posted 10 Days Ago
Be an Early Applicant
West Haddon, Northamptonshire, England, GBR
Hybrid
40K-45K Annually
Mid level
Software
The Role
Build, test, monitor and maintain cloud-ready data pipelines and platform infrastructure using CI/CD, IaC and DevOps. Ensure security, observability and data governance. Use AWS, PostgreSQL and scripting to deliver scalable solutions, troubleshoot production issues, automate tasks (including AI-assisted tooling), and support stakeholders through documentation and mentoring.
Summary Generated by Built In
We’re seeking an Intermediate Data Engineer to join our Insurance Retail department, supporting development squads with reliable, automated and cloud-ready data solutions. This role is suited to someone who can combine strong SQL, scripting and AWS experience with modern DevOps practices to build, maintain and improve data pipelines, data services and supporting infrastructure.
AI is a key part of the role. You will be expected to use AI-assisted engineering tools responsibly to accelerate development, improve documentation, support analysis and identify opportunities to automate repeatable data engineering and operational tasks. Working closely with engineers, analysts, architects and stakeholders, you will help turn data requirements into maintainable, observable and secure solutions.
You will maintain awareness of industry and technology developments, contribute to technical discussions, and support continuous improvement across data engineering, automation and operational practices. The role includes ownership of work throughout its lifecycle, from development and testing through to production support, incident resolution, continuous improvement and knowledge sharing across the department.
About CDL
CDL is one of the UK’s leading software development houses, employing over 600 people at its campus in Stockport. It has a consistent history in the high-volume retail insurance sector. CDL has spearheaded developments in the aggregator, web and telematics space, including connected home, enrichment and self-service solutions. As a result, the company’s robust and innovative technologies have enabled its customers to thrive in the highly competitive UK insurance marketplace.
We have built a collaborative and creative culture, leveraging AI-driven solutions to enhance our products, processes and decision-making. We pride ourselves on cultivating an inspiring working environment with our employees at the heart of our company.
In a nutshell we are the market leading software house in our industry, creating the software, websites & apps for the Insurance & Finance sector across the UK. If you were to go on a price comparison website, approximately 65% of the companies on there are our clients!

What You'll Do
  • Building, testing, monitoring and maintaining data pipelines and infrastructure to support the Data Platform using best practices including CI/CD, IaC and DevOps.
  • Apply security best practices across data pipelines, cloud infrastructure and operational processes, ensuring data is protected through appropriate access controls, encryption, monitoring and secure engineering practices
  • Use AWS services and PostgreSQL/AWS RDS knowledge to design, deliver and support scalable, reliable and secure data solutions, ensuring appropriate governance, resilience and protection of business data.
  • Actively embrace AI-assisted engineering practices and demonstrate a willingness to learn, experiment with and responsibly adopt emerging AI tools such as Kiro, GitHub Copilot or equivalent technologies to improve delivery flow, quality, documentation, analysis and operational efficiency.
  • Develop and maintain automated deployment, testing and operational workflows using GitLab pipelines, version control, Terraform/OpenTofu and scripting.
  • Contribute to data quality, lineage, governance and observability practices to ensure data is trusted, traceable, secure and supportable throughout its lifecycle.
  • Investigate data quality, platform reliability, pipeline performance and operational issues, identifying practical improvements, preventative actions and automation opportunities that enable squads to move faster and more safely.
  • Working with business stakeholders, analysts and architects to understand business and technical requirements, designing data models and data structures that support reporting, analytics and operational use cases.
  • Contribute to database and data platform activities such as upgrades, data migrations, schema updates and platform modernisation initiatives.
  • Documenting processes and products, sharing knowledge across the squad and wider business, and supporting the development of less experienced engineers through mentoring, pairing or technical guidance where appropriate.
  • Contribute significantly to small-to-medium feature deliveries and multi-person initiatives, collaborating with engineers and stakeholders to deliver reliable outcomes.

About You
  • Hold, or be willing to obtain, a relevant AWS certification that can be registered against the CDL APN.
  • Proven experience working with AWS services relevant to data engineering and operational support, such as RDS, S3, Lambda, ECS, EC2, VPC, CloudWatch and related services. 
  • Experience with MySql and Oracle databases would be advantageous. 
  • Strong SQL skills, including PostgreSQL experience, query optimisation awareness and the ability to investigate data or performance issues. 
  • Good understanding of security principles including least-privilege access, encryption, secrets management, vulnerability remediation and secure handling of sensitive data.
  • Experience with CI/CD pipelines, automated testing and deployment practices using GitLab or similar tooling. 
  • Experience with Infrastructure as Code tools such as Terraform, OpenTofu or CloudFormation. 
  • Good understanding of version control workflows, branching strategies and GitLab best practice. 
  • Experience of, or a strong willingness to learn, AI-assisted engineering tools such as Kiro, GitHub Copilot or similar technologies to improve engineering effectiveness and delivery outcomes.
  • Familiarity with observability and troubleshooting tooling such as Dynatrace, OpenSearch/Elasticsearch or CloudWatch logs. 
  • Ability to communicate clearly, analyse problems, work collaboratively and explain technical concepts to both technical and non-technical stakeholders. 
  • Familiarity with Agile methodologies and operational tooling such as Jira and ServiceNow.

What You'll Get
Salary

The salary for the role of Intermediate Data Engineer pays up to £45,000p.a. (Level 4) providing a fantastic opportunity for career progression through CDL’s clearly defined career framework (https://progression.cdl.co.uk/).
Your growth and advancement within CDL are only limited by your own ambition and effort.
Benefits

🏠🏢 Hybrid Working (2 Days a Week in the office - SK4 2HD)
⏱️ Flexible working.
🌴 25 days holiday to start, increasing by 1 day per 1 year of service up to 30 days.
🏆 Top employer for 10th year running
🌱 Excellent training and development platform
🪜 Opportunities for career progression
💙 Health and Wellbeing Programme
☕ Virtual activities, lunch and learns, coffee mornings and meetups.
🛡️ Life and health assurance
⚡🚗 Electric Vehicle Scheme
🎖️ Established Recognition Award System
👶 Great Parental Benefits
🌍 Diversity and Inclusion network
💰 Pension scheme
🤝 Community projects and volunteer days
👥💸 Refer a friend bonus
Campus Benefits:
🅿️ On-site free parking
🏢 Open plan modern offices
🤫 Quiet Spaces are also available
🚌 Shuttle bus to and from the station
🍽️ Subsidised restaurant
🎮 Games room, pool & table-tennis tables and chill out zone
💻⚙️ Annual Hackathon & Deep Racer Events
🎉 Social activities, regular social events through our social group Xtra, including a summer BBQ, competitions, bowling, go-karting, football games, Winter party and much more!
💇‍♂️ Car wash, barber, yoga classes, boot camp and massage services all on site
🚲 Cycle to work scheme
🚿 Shower and dry rooms
Diversity and inclusion:
We’re on a journey to keep innovating, that means welcoming new ideas and ways of thinking.
CDL recognises that building a diverse workforce is critical to the success of our business. We strongly encourage applications from a diverse talent pool and welcome the opportunity to discuss flexibility requirements and workplace adjustments with all our applicants.
Recruitment Agency Notice:
CDL have a PSL in place, but haven't used them for over 3 years, therefore be advised that any unsolicited submission of candidate details - including but not limited to LinkedIn profiles, CVs, or resumes (whether redacted or unredacted) - will be considered freely given and unsolicited. As such, these submissions will not be subject to any fees, terms, or obligations on our part.
Only candidate profiles that have been formally discussed with and approved by our Talent Acquisition (TA) team prior to submission AND submitted by agencies on our Preferred Supplier List (PSL) operating under agreed terms are authorised to submit candidates. Any submissions from non-PSL agencies, or those made outside of agreed processes, will be deemed non-compliant and will not be eligible for any fees or consideration.

About
The UKs biggest insurance retailers rely on CDLs trend setting solutions to drive success and growth. Our ambition and commitment has produced a track record of delivering exactly that. The result is a client base that includes some of the most profitable insurance operations in the UK.

Skills Required

  • Hold or be willing to obtain a relevant AWS certification
  • Proven experience with AWS services for data engineering (RDS, S3, Lambda, ECS, EC2, VPC, CloudWatch)
  • Strong SQL skills including PostgreSQL and query optimisation
  • Experience with CI/CD pipelines and GitLab
  • Experience with Infrastructure as Code (Terraform, OpenTofu or CloudFormation)
  • Understanding of security principles: least-privilege, encryption, secrets management, vulnerability remediation
  • Familiarity with observability and troubleshooting tooling (Dynatrace, OpenSearch/Elasticsearch or CloudWatch logs)
  • Experience with version control workflows and branching strategies (Git/GitLab)
  • Experience of, or willingness to learn, AI-assisted engineering tools (Kiro, GitHub Copilot or similar)
  • Familiarity with Agile methodologies and operational tooling (Jira, ServiceNow)
  • Ability to communicate clearly, collaborate with stakeholders and support/mentor less experienced engineers
  • Experience with MySQL and Oracle databases
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Stockport
500 Employees
Year Founded: 1977

What We Do

CDL is a market leader in software solutions for high volume retail insurance operations and is highly regarded as an independent, financially stable and trusted partner. We’ve made it our business to anticipate market trends and develop technology to capitalise on them. Our customers have been at the vanguard of change and CDL Strata provides a scalable and flexible multi-channel solution encompassing web, mobile, price comparison sites, consumer self-service and telematics-based insurance products. We’re committed to being the best at what we do, which is why we invest around 15% of turnover in research and development each year. CDL has grown organically over the past three decades, today employing over 600 people at our state-of-the-art headquarters in Stockport. CDL customers choose us because we increase choice, efficiency and profitability through our reliable high speed retail technology and distribution channels, integrated on one powerful database. Many of the UK's most efficient and profitable insurance retailers use CDL systems because we deliver on time, and because they know our solutions work. Above all, clients choose CDL because we create powerful partnerships.

Similar Jobs

IDEXX Logo IDEXX

Data Engineer

Healthtech • Pet • Biotech
In-Office
London, Greater London, England, GBR
6764 Employees
Hybrid
London, Greater London, England, GBR
289097 Employees

tms Logo tms

Business Development Director

Agency • Gaming • Marketing Tech • Mobile • Analytics
Hybrid
London, Greater London, England, GBR
1296 Employees

Wise Logo Wise

Senior Software Engineer

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
London, Greater London, England, GBR
9000 Employees
111K-145K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account