Top Data Engineer Jobs in Glasgow

12 Days AgoSaved
Hybrid
Glasgow, City of Glasgow, Scotland, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Designs, builds, and deploys scalable Azure Databricks data engineering pipelines. Responsibilities include developing Delta Lake and streaming solutions, implementing event-driven architectures with Kafka and Azure Event Hubs, creating CI/CD pipelines, optimizing data lifecycles, and translating client data requirements into secure technical solutions. The role also promotes clean code, lakehouse architecture, GDPR compliance, and engineering best practices within consulting teams.
Top Skills: SparkAzureAzure DevopsAzure Event HubsClouderaDatabricksDelta LakeGithub ActionsHadoopHiveJavaJenkinsKafkaPysparkPythonScalaSpark Structured StreamingSQLUnity Catalog
2 Days AgoSaved
In-Office or Remote
2 Locations
Expert/Leader
Expert/Leader
Fintech
Principal Data Engineer responsible for designing and building scalable enterprise data products using Databricks, Spark, Python, SQL, and lakehouse technologies. The role covers architecture, data ingestion and transformation, cloud integration, testing, CI/CD, observability, data quality, AI-assisted engineering, troubleshooting, prototyping, and modernization. It also requires technical influence through design reviews, coaching, estimation, and collaboration across a distributed engineering team.
Top Skills: SparkAPIsAzureCi/CdCloud PlatformsDatabricksLakehouseMicrosoft FabricPysparkPythonSQL
3 Days AgoSaved
Remote
UK
Entry level
Entry level
Cloud • Information Technology
Principal Data Engineer responsible for designing and delivering enterprise-scale Databricks and cloud-native data platforms across client engagements. The role combines hands-on architecture, technical leadership, stakeholder consulting, platform optimization, governance, delivery execution, and mentoring. Candidates will lead modern data engineering initiatives using Azure and/or AWS, PySpark, SparkSQL, SQL, distributed processing, ETL/ELT, and DevOps practices while advising senior client stakeholders and guiding engineering teams.
Top Skills: SparkAWSAzureDatabricksDevOpsEtl/EltPysparkSparksqlSQL
5 Days AgoSaved
Remote
GBR
Entry level
Entry level
Artificial Intelligence • Analytics • Business Intelligence • Consulting
Designs and builds production-grade batch and streaming data pipelines and modern Lakehouse platforms using Databricks, Spark, Delta Lake, and SQL. Responsibilities include data ingestion, modelling, quality, monitoring, governance, lineage, performance optimization, CI/CD, and infrastructure automation. The role collaborates with architects, clients, analytics, machine learning, and AI teams across enterprise engagements, while contributing to engineering best practices and consulting delivery.
Top Skills: SparkAWSAzureCi/CdDatabricksDatabricks Asset BundlesDelta LakeGCPGitKafkaMedallion ArchitectureMlflowPysparkSQLStructured StreamingTerraformUnity Catalog
9 Days AgoSaved
Remote
United Kingdom
45K-50K Annually
Entry level
45K-50K Annually
Entry level
Agriculture
Design, build, migrate, and optimise scalable Azure data solutions, including storage schemas, data pipelines, models, and processing workflows. Use Azure Databricks and Data Factory to integrate and transform large datasets, while ensuring data quality, security, privacy, and performance. Collaborate with product, analysis, development, testing, and analytics teams to deliver reliable data products and support reporting needs.
Top Skills: Azure Data FactoryAzure Data LakeAzure DatabricksAzure DevopsAzure SynapseGdprAzurePythonSQLT-Sql
10 Days AgoSaved
Remote
UK
Expert/Leader
Expert/Leader
Cloud • Information Technology
Principal Data Engineer responsible for leading complex data architecture, cloud platform strategy, delivery performance, incident response, governance, and compliance. Serves as the primary technical advisor to clients, ensuring scalable, resilient, secure data platforms. Oversees team-of-teams execution, capacity planning, budgets, hiring, stakeholder communication, and mentorship while driving technical standards and long-term business value.
Top Skills: AWSAzureDatabricksETLNon-Relational DatabasesPysparkPythonRelational DatabasesSparksqlSQL
20 Days AgoSaved
Hybrid
Glasgow, City of Glasgow, Scotland, GBR
Entry level
Entry level
Agency • Digital Media • Professional Services • Design
Develop and support large-scale financial data workflows using Spark, Scala, Python, Airflow, SQL, and PostgreSQL. Build reusable data engineering components, optimize queries, troubleshoot production issues, and improve monitoring, automation, reconciliation, and operational resilience. Collaborate with application, platform, database, infrastructure, and downstream teams while following security, risk, testing, documentation, and change-control standards. The role is hybrid and requires BPSS eligibility.
Top Skills: Apache AirflowSparkAws S3Ci/CdDockerGitlabHelmKubernetesOpenshiftPostgresPythonReact JsScalaSharedview SparkSQLStarburstTrino
15 Days AgoSaved
Remote
6 Locations
Junior
Junior
HR Tech • Software
Designs and maintains scalable ETL and ELT pipelines, data architectures, databases, and warehouses. Integrates data from APIs and third-party platforms while ensuring quality, security, governance, and reliability. Monitors workflows, improves processing and query performance, supports analytics and business intelligence initiatives, and documents technical processes. Collaborates with analysts, engineers, data scientists, and business stakeholders in a fully remote environment.
Top Skills: Amazon RedshiftApache AirflowAWSBigQueryDatabricksEltETLGoogle Cloud PlatformJavaAzurePrefectPythonScalaSnowflakeSQL
Reposted One Month AgoSaved
Hybrid
2 Locations
Mid level
Mid level
Financial Services
Build and maintain secure, scalable data pipelines, architectures, and analytics solutions supporting AI and risk initiatives. Responsibilities include data provisioning, governance, lineage, metadata management, data quality controls, platform security, AI-assisted development, rapid prototyping, and operational stability. The role collaborates with business, technology, and control stakeholders to improve data flows, reduce operational effort, and support data products, AI/ML deployment, and natural-language query capabilities.
Top Skills: Ai/MlClaude CodeCloud PlatformsDatabricksGithub CopilotGraph DatabasesLlmopsMetadata Management PlatformsMlopsPythonRReactSparkSQLVector Databases
19 Days AgoSaved
Remote
United Kingdom
Expert/Leader
Expert/Leader
Utilities
Provide technical leadership for ENSEK’s data ecosystem, owning data architecture, platform strategy, roadmap, and data mesh adoption. Establish standards for event-driven architecture, schema governance, data quality, observability, lineage, metadata, security, and cost management. Design governed data-sharing interfaces for customers and partners, solve complex engineering challenges, influence senior stakeholders, and mentor engineering teams.
Top Skills: Apache IcebergAPIsAvroAWSCi/CdKafkaKinesisMlopsSchema RegistrySQL
Reposted 11 Days AgoSaved
Hybrid
2 Locations
Senior level
Senior level
Information Technology • Business Intelligence
Lead and architect enterprise-scale cloud data solutions, mentor data engineers, design and build batch and streaming pipelines using Databricks and Microsoft Fabric, implement Lakehouse/Medallion patterns, ensure data governance/security, and drive CI/CD and IaC practices across projects.
Top Skills: Adls Gen2Azure Data FactoryAzure DatabricksAzure Synapse AnalyticsCi/CdDatabricks WorkflowsDelta Live TablesDevOpsGitInfrastructure As CodeLakehouseMedallion ArchitectureMicrosoft FabricPysparkPythonSQL
26 Days AgoSaved
In-Office or Remote
7 Locations
Entry level
Entry level
Artificial Intelligence • Software
Own EULER’s data lifecycle, including instrumentation, validation, reconciliation, privacy, anonymization, canonical data modeling, analytics datasets, documentation, and production pipelines. The role requires strong SQL, software engineering practices, independent ownership, skepticism toward data quality, and clear communication. Preferred experience includes GDPR/LGPD, multi-tenant B2B SaaS, dbt, statistics, Cloudflare Workers, Postgres, Parquet, DuckDB, and Bubble.
Top Skills: BubbleCloudflare WorkersDbtDuckdbHyperdriveParquetPostgresSQL
New

Cut your apply time in half.

Use ourAI Assistantto automatically fill your job applications.

Use For Free
Application Tracker Preview
Reposted 27 Days AgoSaved
Remote
8 Locations
Mid level
Mid level
Artificial Intelligence • Information Technology
The Data Engineer will build and scale data pipelines, ensure data quality, implement dbt best practices, and empower cross-functional teams with self-service data access.
Top Skills: Bi ToolsDbtPythonSQL
5 Days AgoSaved
Remote
GBR
Senior level
Senior level
Artificial Intelligence • Analytics • Business Intelligence • Consulting
Design and deliver scalable batch and streaming data platforms using Spark, Databricks, Delta Lake, and Lakehouse architecture. Build ingestion frameworks, implement data quality, governance, monitoring, lineage, and access controls, and optimize workloads for performance and cost. Collaborate with architects, clients, and business stakeholders to deliver production-ready analytics, machine learning, and AI solutions. Contribute to CI/CD, infrastructure as code, engineering standards, knowledge sharing, and consulting delivery.
Top Skills: SparkAWSAzureCi/CdDatabricksDatabricks Asset BundlesDelta LakeGCPGitInfrastructure As CodeKafkaMlflowPysparkSQLStructured StreamingTerraformUnity Catalog
Reposted 5 Days AgoSaved
Remote
GBR
176K-230K Annually
Senior level
176K-230K Annually
Senior level
Generative AI
Own the company-wide AWS data platform, including lakehouse architecture, warehouse modeling, SaaS integrations, orchestration, infrastructure, governance, reporting, and reliability. Build scalable multimodal data pipelines for audio, video, image, and 3D model training datasets using cloud and HPC systems. Partner with Finance, Security, Product, Research, and other teams; lead design reviews, mentor engineers, maintain documentation, and participate in on-call support.
Top Skills: AirflowAmazon EksAmazon S3Apache IcebergSparkArgoAthenaAuth0AWSBigQueryCi/CdCustomer.IoDbtEmrErpEventbridgeGithub ActionsGlueHelmHubspotKubernetesOpentelemetryPostgresPosthogPythonQuicksightSlurmSnowflakeSQLStep FunctionsStripeTerraformTrino
6 Days AgoSaved
Remote
United Kingdom
Senior level
Senior level
Edtech
Designs and operates enterprise analytics platforms, Power BI reporting, Microsoft Fabric architectures, data models, and Python-based transformations. Builds Power Platform automations and applications, establishes governance, security, deployment, and operational practices, and enables analysts and citizen developers. Develops production ML, GenAI, agentic AI, and RAG solutions with monitoring, evaluation, LLMOps, and secure enterprise deployment patterns.
Top Skills: AutogenAzure Ai FoundryAzure Data FactoryAzure OpenaiAzure SqlAzure SynapseDataverseDaxGcp BigqueryLangchainLookerMicrosoft FabricOnelakePower AppsPower AutomatePower BIPythonSemantic KernelSQL
One Month AgoSaved
Remote
United Kingdom
Expert/Leader
Expert/Leader
Information Technology • Software
Lead the technical direction of data engineering across client engagements. Design migration frameworks, streaming architectures, Lakehouse platforms, data integrity systems, and regulatory reporting pipelines. Provide architectural authority, review technical designs, select cloud services, mentor senior engineers, develop reusable delivery patterns, support hiring, and represent the consultancy externally. Shape proposals, scope technical engagements, present to senior stakeholders, and identify opportunities with existing clients.
Top Skills: Amazon AthenaAmazon KinesisAmazon MskAmazon RdsAmazon RedshiftAmazon S3Apache AirflowApache FlinkApache KafkaSparkAWSAws CdkAws GlueAws Lake FormationAws LambdaAws Step FunctionsDbtMwaaPythonSpark StreamingSQLTerraform
Reposted 9 Days AgoSaved
Remote
2 Locations
Senior level
Senior level
Hardware • Information Technology • Other • Software • Analytics
Build and scale governed data products, pipelines, analytical models, semantic layers, APIs, and AI-enabled interfaces. Establish standards for data modeling, orchestration, testing, observability, CI/CD, security, and lifecycle management. Partner with stakeholders to define data contracts and product roadmaps, deliver solutions end to end, improve analytics governance, and mentor colleagues. The role requires strong data and analytics engineering expertise, product judgment, and practical experience directing AI coding agents.
Top Skills: AirflowAPIsBigQueryCi/CdData CatalogsDbtGitGoogle Cloud Platform (Gcp)Mcp ServersMetric StoresPythonSemantic LayerSQL
12 Days AgoSaved
Remote or Hybrid
United Kingdom
Senior level
Senior level
Analytics
Own and scale high-throughput batch and streaming data pipelines for maritime telemetry and predictive analytics. Design and optimize Apache HBase storage architectures, operate containerized AWS infrastructure, and establish reliability metrics for pipeline performance and SLAs. Collaborate with data scientists, product managers, and SRE teams to deliver production-grade infrastructure. Mentor engineers, improve code review standards, and use AI-assisted development tools.
Top Skills: Apache AirflowApache FlinkApache HbaseApache KafkaAWSClaude CodeCopilotCursorDockerGeoserverGitopsJavaKubernetesPostgresTerraform
15 Days AgoSaved
Remote
United Kingdom
Senior level
Senior level
Information Technology • Software • Consulting • Automation
Build and maintain scalable ETL pipelines, data models, ingestion processes, and optimized data products using Azure Databricks and related Azure services. Develop raw, refined, and curated data layers, implement testing and secure ETL designs, monitor pipeline performance, resolve incidents, document solutions, and participate in Agile delivery and governance. Collaborate with architects, analysts, engineers, and stakeholders on modern data platform development.
Top Skills: ApimAzure Data FactoryAzure DatabricksEntra IdEvent GridAzureMicrosoft FabricMicrosoft PurviewPower BIPub/SubPysparkPythonScimSQL
15 Days AgoSaved
Remote
3 Locations
Senior level
Senior level
Artificial Intelligence • Software
Build AI-ready data infrastructure by designing event tracking plans, developing dbt models, and managing ingestion pipelines into Snowflake. Own data quality, metric definitions, documentation, semantic layers, and reporting consistency across Amplitude and Snowflake. Orchestrate workflows with Airflow and collaborate with product, engineering, and analytics teams to deliver reliable data products.
Top Skills: AirflowAmplitudeCubeDbtDlthubFivetranGoogle Cloud PlatformLlmsLookerMcpMixpanelPythonSegmentSnowflakeSQLStitchWeld
One Month AgoSaved
In-Office or Remote
7 Locations
Entry level
Entry level
Database
Build and maintain FinOps data pipelines, BigQuery and dbt models, cost attribution systems, forecasting and anomaly detection models, and cost-versus-revenue analytics. Identify and implement AWS and GCP savings opportunities, automate governance with Python, Terraform, and Lambda, and partner with Engineering, Finance, Product, and leadership on cloud costs, forecasting, reporting, and architecture decisions.
Top Skills: AWSAws Cost And Usage ReportsAws Cost ExplorerAws LambdaBashBigQueryCloudzeroDbtGCPGcp Billing ReportsHexLinearNotionPulumiPythonSQLTerraformVantage
17 Days AgoSaved
In-Office or Remote
2 Locations
Senior level
Senior level
Marketing Tech
Build and operate OrderYOYO’s production data and AI platform, including Microsoft Fabric lakehouse solutions, scalable ingestion pipelines, semantic models, monitoring, data quality, and legacy-platform migrations. Develop with Python, PySpark, SQL, and T-SQL; manage performance, cost, and reliability; and collaborate with Finance, Product, executives, and engineering. Deliver applied AI and machine-learning capabilities such as RAG, agents, churn, recommendations, personalization, fraud, and risk models.
Top Skills: AdlsSparkAzure DatabricksAzure Key VaultAzure OpenaiAzure SqlAzure SynapseBicepDaxDelta LakeAzureMicrosoft Entra IdMicrosoft FabricOnelakePower BIPysparkPythonRagRbacSemantic ModelsSQLT-SqlTerraform
Reposted One Month AgoSaved
Hybrid
2 Locations
Entry level
Entry level
Financial Services
Lead data engineering for AI and analytics initiatives, building secure and scalable data pipelines, platforms, and tooling. Responsibilities include data profiling, quality remediation, lineage and metadata management, governance controls, analytics prototyping, AI-assisted development, and operational stability. The role partners with business, technology, risk, and executive stakeholders while driving data product adoption, AI readiness, regulatory traceability, and continuous improvement across enterprise data flows.
Top Skills: Ai/MlClaude CodeCloud PlatformsDatabricksGithub CopilotGraph DatabasesLlmopsMlopsNatural Language Query (Nlq)PythonRReactSparkSQLVector Databases
18 Days AgoSaved
Remote
GBR
Senior level
Senior level
Software • Cryptocurrency
Design, build, and optimize Phantom’s streaming blockchain data platform, including scalable ETL pipelines, data models, schemas, quality frameworks, observability, and high-availability systems. The role delivers accurate, low-latency token, price, and spam data to engineering teams, collaborates cross-functionally, and contributes to team growth. Experience with backend systems, modern data engineering, and Web3 or on-chain data is expected.
Top Skills: BlockchainETLGoKafkaNestjsNode.jsOn-Chain DataPostgresRedisTypescript
All Filters
JobType
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account