Senior Data Engineer

Posted 9 Hours Ago
Be an Early Applicant
2 Locations
In-Office
Senior level
Cloud • Digital Media • Information Technology • Software
The Role
Designs, develops, and maintains scalable data pipelines, integrations, and cloud-based data services in Microsoft Azure. Implements automated ingestion, transformation, CI/CD, Infrastructure as Code, data governance, security, and quality practices. Optimizes platforms for performance, reliability, scalability, and cost, while troubleshooting complex issues and collaborating with architects, engineers, and stakeholders in Agile delivery teams.
Summary Generated by Built In

At UBDS, we help organisations transform through cloud, cyber security, AI and digital innovation. We're looking for an experienced Senior Data Engineer to support the design, development and delivery of modern data solutions within Microsoft Azure environments.

This is a hands-on engineering role focused on building scalable data pipelines, integrating data services and delivering secure, reliable cloud-based data solutions. You'll work closely with Data Architects, Cloud Engineers and wider delivery teams to develop robust data platforms that support business intelligence, analytics and digital transformation.

You'll also play an important role in embedding data governance, automation and engineering best practices, ensuring solutions are secure, maintainable and aligned with enterprise standards.

What You'll Do
  • Design, develop and maintain scalable data pipelines and integration solutions using Microsoft Azure.
  • Build and support cloud-based data services, storage and processing capabilities.
  • Develop automated data ingestion, transformation and processing workflows.
  • Implement data governance and management practices aligned with Microsoft Purview.
  • Support data quality, lineage, classification and appropriate access controls.
  • Develop and maintain CI/CD pipelines to automate data platform deployments.
  • Support Azure infrastructure configuration and secure deployment of data services.
  • Apply Infrastructure as Code and modern DevOps engineering practices.
  • Develop and maintain integrations between data platforms, applications and cloud services.
  • Support the secure deployment and integration of cloud-based analytics and data processing capabilities.
  • Optimise data pipelines for performance, scalability, reliability and cost efficiency.
  • Troubleshoot complex data processing, integration and deployment issues.
  • Collaborate with Architects, Engineers and stakeholders to translate requirements into effective technical solutions.
  • Contribute to technical design, code reviews, engineering standards and documentation.
  • Work within Agile delivery teams, supporting iterative development and continuous improvement.
What We're Looking For
  • Strong experience as a Data Engineer or Senior Data Engineer within cloud-based environments.
  • Hands-on experience developing and supporting data solutions using Microsoft Azure.
  • Experience designing and building ETL/ELT pipelines and data integration workflows.
  • Experience working with Azure data services and cloud-based storage technologies.
  • Understanding of Microsoft Purview and data governance principles.
  • Experience with CI/CD pipelines, deployment automation and version control.
  • Knowledge of Azure infrastructure, networking, identity and security fundamentals.
  • Experience implementing secure, scalable and maintainable data solutions.
  • Strong understanding of data modelling, transformation and integration principles.
  • Good software engineering practices, including testing, documentation and code quality.
  • Strong analytical, troubleshooting and problem-solving skills.
  • Experience working within Agile, multidisciplinary delivery teams.
  • Strong communication and stakeholder engagement skills.
Desirable Experience

Experience across some of the following would be beneficial:

  • Azure Data Factory, Azure Databricks or Microsoft Fabric.
  • Azure Data Lake Storage and Azure SQL.
  • Python, SQL and PySpark.
  • Microsoft Purview data cataloguing, lineage and governance.
  • Terraform, Bicep or other Infrastructure as Code tooling.
  • Azure DevOps or GitHub Actions.
  • Data lake, lakehouse and modern data platform architectures.
  • Data security, encryption and access management.
  • Experience supporting cloud-based analytics or AI-enabled data platforms.
  • Experience delivering solutions within Government, Defence or other regulated environments.
  • Relevant Microsoft Azure or data engineering certifications.
Security Clearance

This role requires candidates to successfully complete Baseline Personnel Security Standard (BPSS) checks.

Any appointment will be subject to the required pre-employment screening and security checks.

The Opportunity

This role would suit an experienced Data Engineer who enjoys hands-on technical delivery and building modern, scalable data solutions.

You'll work alongside experienced Data, Cloud and Engineering specialists, contributing to the delivery of secure, reliable data platforms and helping organisations make better use of their data.

You'll also have the opportunity to influence engineering practices, improve automation and contribute to the continued development of UBDS's Data and Digital capabilities.


Benefits

Why people choose to grow their careers at UBDS Group


Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.


UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.


Employee Benefits

  • Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
  • Private medical cover for you and your spouse/partner, offered via Vitality
  • Discretionary bonus based on a blend of personal and company performance
  • Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
  • Electric Vehicle leasing with salary sacrifice
  • Contributed Pension Scheme
  • Death in service cover
  • Hybrid Working – UBDS Group offers a flexible working environment to help enable you to operate at your maximum regardless of your location. With offices in London & Manchester we offer a culture that is focussed on outcomes and giving you a work life balance but at that same time creating and driving a culture of inclusivity and togetherness

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

With a portfolio including UBDS Digital and Rayo, UBDS Group Companies proudly offer comprehensive, end-to-end digital solutions tailored for both the public and private sectors. By harnessing the strengths of leading technology partners, we deliver innovative strategies, services and solutions that address complex challenges and drive significant value. Our services cover digital consulting, cloud platforms, data and ai, cybersecurity, managed services and delivery management.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.

Skills Required

  • Strong experience as a Data Engineer or Senior Data Engineer in cloud-based environments
  • Hands-on experience developing and supporting data solutions using Microsoft Azure
  • Experience designing and building ETL/ELT pipelines and data integration workflows
  • Experience working with Azure data services and cloud-based storage technologies
  • Understanding of Microsoft Purview and data governance principles
  • Experience with CI/CD pipelines, deployment automation, and version control
  • Knowledge of Azure infrastructure, networking, identity, and security fundamentals
  • Experience implementing secure, scalable, and maintainable data solutions
  • Strong understanding of data modelling, transformation, and integration principles
  • Good software engineering practices, including testing, documentation, and code quality
  • Strong analytical, troubleshooting, and problem-solving skills
  • Experience working within Agile, multidisciplinary delivery teams
  • Strong communication and stakeholder engagement skills
  • Experience with Azure Data Factory, Azure Databricks, or Microsoft Fabric
  • Experience with Azure Data Lake Storage and Azure SQL
  • Experience with Python, SQL, and PySpark
  • Experience with Microsoft Purview data cataloguing, lineage, and governance
  • Experience with Terraform, Bicep, or other Infrastructure as Code tooling
  • Experience with Azure DevOps or GitHub Actions
  • Experience with data lake, lakehouse, and modern data platform architectures
  • Experience with data security, encryption, and access management
  • Experience supporting cloud-based analytics or AI-enabled data platforms
  • Experience delivering solutions within Government, Defence, or other regulated environments
  • Relevant Microsoft Azure or data engineering certifications
  • Successful completion of Baseline Personnel Security Standard (BPSS) checks
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
120 Employees
Year Founded: 2000

What We Do

UBDS Digital, a brand on a mission to deliver unparalleled client value, unmatched employee experience, and to make a meaningful difference in society. We understand your needs deeply and are laser focused on outcomes, never compromising on quality or security. We are your visionary partner, taking on complex work, creating smarter solutions, with innovative technologies, for the best results and producing lasting progress, for all. In September 2024, UBDS Digital became B Corp Certified. This certification affirms our commitment to purpose-driven practices and using business as a force for positive change. We are proud to align each project with the broader mission of benefiting all stakeholders, not just shareholders, and to be part of a movement of forward-thinking companies that prioritise societal impact.

Similar Jobs

Wise Logo Wise

Senior Data Engineer

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
London, Greater London, England, GBR
9000 Employees

Wise Logo Wise

Senior Data Engineer

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
London, Greater London, England, GBR
9000 Employees
111K-145K Annually

Flatiron Health Logo Flatiron Health

Senior Software Engineer

Healthtech • Software • Biotech • Pharmaceutical
Hybrid
London, Greater London, England, GBR
2500 Employees

AeroVect Logo AeroVect

Senior Data Engineer

Aerospace • Automation
In-Office or Remote
12 Locations
23 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account