Top Data Engineer Jobs in Glasgow

Build and operate scalable cloud data pipelines, warehouses, transformation layers, and ML production systems. Lead data infrastructure architecture, warehouse performance optimization, DataOps monitoring, CI/CD improvements, data quality testing, and large-scale data product delivery. Collaborate across teams, promote data stewardship, and support batch and streaming pipelines while deploying, serving, and monitoring machine learning models.

Design, build, and maintain scalable data pipelines and Microsoft Fabric artefacts; integrate data into Azure Data Lake/OneLake; perform ELT/ETL and advanced transformations using SQL, Python, and Spark; support Power BI models; apply Purview governance; troubleshoot production issues; participate in CI/CD and mentor junior engineers while engaging with clients and cross-functional teams.

Build and evolve CluePoints’ enterprise data platform using Microsoft Fabric and Azure. Responsibilities include migrating Azure SQL and ADF workloads, integrating SaaS and web data, developing scalable ingestion and transformation pipelines, maintaining Kimball dimensional models, and establishing CI/CD, data quality, lineage, security, and monitoring. The role partners with analytics leadership and supports trusted Power BI reporting across multiple business functions.

Designs and delivers scalable data pipelines and Lakehouse architectures using Databricks, Spark, PySpark, and Delta Lake. The role covers ETL/ELT, data governance, security, quality, performance optimization, cloud integration, and CI/CD. It involves technical leadership across customer programmes, architectural decision-making, stakeholder collaboration, mentoring, and supporting reliable production data solutions.

Design, build, and optimize cloud-based data platform components: ingest and transform varied datasets, create metadata-driven pipelines and data APIs, support AI/ML infrastructure, implement monitoring and metrics, and improve data processes to enable analytics and operational systems.

Build, test, optimize, and maintain ELT pipelines supporting analytics, reporting, and data products. Deploy config-driven workflows to Databricks across a multi-tenant environment, extend data models, support CI/CD and ingestion projects, monitor pipeline health, troubleshoot failures, and collaborate with data and product teams to deliver reliable, well-tested data.

Lead the technical direction and architecture for Arbor’s data platform, spanning transactional, analytical, and AI systems. Define target architectures, guide technical leads, support product delivery, and enable AI-first engineering through LLM orchestration, RAG, and real-time inference infrastructure. The role includes mentoring, architectural reviews, data governance, security, compliance, observability, DataOps, cloud platform cost optimization, and cross-functional collaboration with product and commercial leaders.

Own the end-to-end design, reliability, resilience, and recovery of production data ingestion systems and pipelines. Build batch and streaming ETL/ELT workflows, establish data quality checks and SLAs, improve monitoring and alerting, resolve platform issues, reduce technical debt, and optimize performance and cost. Collaborate with stakeholders, AI teams, and international expansion initiatives while supporting time-series, textual, and event-stream data workloads.

Own the design, delivery, and operation of complex data pipelines, datasets, and platform components. Translate business needs into scalable data models and reliable data products, improve data quality and observability, resolve production issues, and establish reusable engineering tools and standards. Collaborate with product and business stakeholders, contribute to architecture decisions, mentor engineers, and participate in on-call support.

Lead and architect enterprise-scale cloud data solutions, mentor data engineers, design and build batch and streaming pipelines using Databricks and Microsoft Fabric, implement Lakehouse/Medallion patterns, ensure data governance/security, and drive CI/CD and IaC practices across projects.

As a Data Engineer, you will design, build, and maintain data pipelines and infrastructure to support data-driven decision-making in a collaborative environment.

The Data Engineer will design and support data warehouses, create analytics dashboards, perform data quality analysis, and identify process improvements. Responsibilities include collaborating with stakeholders to develop insights and ensure data governance.

Support ledger migration and data lake cleanup by extracting, transforming, reconciling and validating large datasets. Develop and validate SQL queries, batch jobs and processing logic, perform regression testing, document mappings and validation rules, and collaborate with engineering, product and business teams to ensure production readiness and post-migration validation.

Design, build, and maintain scalable batch and streaming data pipelines, internal tools, and APIs to support analytics, product features, and ML. Collaborate with product and engineering to improve data infrastructure, ensure reliability, testing, and observability in a cloud-native environment.

Design, deploy, and maintain AWS and Databricks data infrastructure, data lakes, and scalable ETL pipelines. Build custom ingestion services and connectors using Airbyte, Go, and Python; optimize performance, reliability, monitoring, and data quality. Implement cloud data governance, security, access controls, encryption, and compliance practices while collaborating with platform engineers, analysts, and stakeholders.

Build, optimise and stabilise AWS-based data pipelines (S3, Glue, Redshift, Lake Formation). Resolve technical debt, support the Architect on target-state design, collaborate with client engineering teams to transfer knowledge, and deliver production-ready platforms in regulated, high-volume gaming environments.

Triage and resolve Master Data Management (Party, Risk, Reference) issues in Stibo STEP, run targeted data-cleansing sprints, monitor data quality dashboards, support releases/UAT, and maintain documentation and playbooks to prevent recurring data issues.

Build and maintain production data pipelines and features in Python; own project lifecycle from design to reliable production; set technical direction for the Insights platform; improve engineering standards (testing, observability, data quality); apply AI across products and pipelines; help establish semantic/AI-ready data layers.

Design, build, test and document secure batch and real-time data pipelines, perform logical/physical database design and data modelling, expand platform capabilities, analyse and resolve data processing issues, and ensure alignment with data architecture for downstream consumers.

Build, test, and document secure batch and real-time data pipelines for a government client; design logical and physical databases; extend platform capabilities; ensure data models align with architecture; perform data analysis and root-cause investigations to improve processing and availability for downstream consumers.

Develop stored procedures or notebooks to build 230 additional data items into DCoE tables/views. Create an extensible, config-driven process to add fields with minimal re-engineering. Produce self-documenting, well-commented code and collaborate with the DCoE team on delivery; DCoE handles business analysis, design sign-offs, data modeling, and testing.

As a Senior Data Engineer, you will design and develop large-scale data processing software, manage technical components, and mentor team members, while ensuring code quality and operational readiness.

Design, build and optimise scalable cloud-native data platforms and pipelines using Microsoft Fabric, Azure Databricks, Synapse and ADF. Implement ETL/ELT with PySpark and SQL, ensure data governance, performance, reliability, and collaborate with data scientists and engineers to deliver production solutions.

Design, build, and maintain scalable cloud-based data platform and ETL pipelines on Azure. Develop data models, ensure data quality, optimize performance, implement governance and security, and collaborate with stakeholders and data scientists to enable data-driven solutions.

As a Senior Data Engineer, you will manage complex data projects, lead small teams, and work with clients on data engineering solutions. Responsibilities include ETL development, data pipeline orchestration, and customer relationship management.