Senior Data Platform Engineer

Posted 15 Days Ago
Be an Early Applicant
London, Greater London, England, GBR
Hybrid
Senior level
Information Technology • Consulting
The Role
Designs, builds, and operates secure, scalable GCP data platforms for financial-sector clients. Develops batch and streaming pipelines, architects data lake and warehouse solutions, manages infrastructure through Terraform and CI/CD, and implements governance, security, monitoring, and data quality practices. Collaborates with stakeholders, communicates architecture decisions, mentors engineers, and promotes DataOps and engineering standards.
Summary Generated by Built In

Bits In Glass (BIG) operates as a rapidly expanding AI and automation consultancy, maintaining presence throughout Canada, the United States, India, and Great Britain. The firm's technical scope encompasses over ten primary platforms across artificial intelligence, cloud infrastructure, data management, automation solutions, and enterprise software.


Honoured internationally as a Great Place to Work and recipient of various partner achievement awards, BIG emphasizes team collaboration, technological innovation, and tangible client outcomes. Our staff consists of skilled engineering professionals dedicated to tackling difficult technical problems, driving joint success, and guiding enterprise organizations through digital transformation with certainty.


Bits In Glass UK is seeking a Senior Data Platform Engineer to design, build and operate secure, scalable data platforms on Google Cloud for financial sector clients. Working closely with client teams, architects and internal stakeholders, you will deliver batch and streaming pipelines, modern data warehouse and lakehouse solutions, and robust governance and security controls using infrastructure-as-code and DataOps practices.

This opportunity suits an experienced GCP data engineer with a strong security mindset, who enjoys solving complex data challenges, mentoring others, and communicating clearly with both technical and non-technical audiences.

Roles and Responsibilities

  • Design, build, and maintain scalable data platforms on Google Cloud Platform for financial sector clients.
  • Develop and optimize batch and streaming data pipelines using services such as Dataflow, Dataproc, Pub/Sub, and Cloud Composer.
  • Architect data lake, data warehouse, and lakehouse solutions, including data modeling and performance tuning in BigQuery.
  • Provision and manage data infrastructure using Terraform and CI/CD pipelines.
  • Implement data governance, lineage, quality, and cataloging frameworks to meet regulatory and client requirements.
  • Apply security best practices across data environments, including IAM, encryption, KMS, data masking, and access controls.
  • Monitor, troubleshoot, and resolve platform performance, reliability, and data quality issues.
  • Collaborate with client teams, architects, and internal stakeholders to translate business needs into technical solutions.
  • Mentor engineers, contribute to technical standards, and promote DataOps and engineering best practices across the team.
  • Communicate architecture decisions, progress, and analysis clearly to technical and non-technical audiences.

Required Skills

  • 7+ years of experience in data engineering or data platform engineering, with at least 3 years in a senior or lead capacity.
  • Strong hands-on experience building and operating data platforms on GCP.
  • Working experience with GCP data services such as BigQuery, Dataflow, Dataproc, Cloud Composer (Airflow), Pub/Sub, Cloud Storage, Bigtable, and Cloud SQL.
  • Proficiency in Python and SQL, with experience in Spark or Apache Beam.
  • Experience designing data warehouse and data lake architectures, including data modeling.
  • Working experience with Terraform and CI/CD tooling such as Jenkins, GitHub, or Cloud Build.
  • Strong understanding of data security in regulated environments.
  • Strong knowledge of DevOps/DataOps and Agile delivery practices.
  • Excellent written and verbal communication skills.
  • Strong analytical, debugging, and problem-solving skills.

Nice to Have

  • GCP Professional Data Engineer or Professional Cloud Architect certification.
  • Experience in banking, insurance, or other regulated financial services environments.
  • Experience with data governance and quality tools such as Dataplex, Data Catalog, dbt, or Great Expectations.
  • Experience with containerization and orchestration (Docker, Kubernetes/GKE).
  • Exposure to other data platforms such as Snowflake, Databricks, or Kafka.
  • Experience supporting AI/ML workloads or Vertex AI pipelines.

Bits In Glass (BIG) operates as a rapidly expanding AI and automation consultancy, maintaining presence throughout Canada, the United States, India, and Great Britain. The firm's technical scope encompasses over ten primary platforms across artificial intelligence, cloud infrastructure, data management, automation solutions, and enterprise software. Our staff consists of skilled engineering professionals dedicated to tackling difficult technical problems, driving joint success, and guiding enterprise organizations through digital transformation with certainty.

Skills Required

  • 7+ years of experience in data engineering or data platform engineering
  • At least 3 years in a senior or lead capacity
  • Hands-on experience building and operating data platforms on Google Cloud Platform
  • Experience with BigQuery, Dataflow, Dataproc, Cloud Composer, Pub/Sub, Cloud Storage, Bigtable, and Cloud SQL
  • Proficiency in Python and SQL
  • Experience with Spark or Apache Beam
  • Experience designing data warehouse and data lake architectures, including data modeling
  • Experience with Terraform and CI/CD tooling such as Jenkins, GitHub, or Cloud Build
  • Strong understanding of data security in regulated environments
  • Knowledge of DevOps, DataOps, and Agile delivery practices
  • Excellent written and verbal communication skills
  • Strong analytical, debugging, and problem-solving skills
  • GCP Professional Data Engineer or Professional Cloud Architect certification
  • Experience in banking, insurance, or other regulated financial services environments
  • Experience with Dataplex, Data Catalog, dbt, or Great Expectations
  • Experience with Docker and Kubernetes/GKE
  • Exposure to Snowflake, Databricks, or Kafka
  • Experience supporting AI/ML workloads or Vertex AI pipelines
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Edmonton, AB
332 Employees
Year Founded: 2002

What We Do

Bits In Glass is an award-winning software consulting firm combining deep industry expertise and experience with the best names in technology to provide innovative solutions to your unique business challenges. Our expert consultants find the innovative solutions to solve the most complex business challenges across multiple industries and verticals. With hundreds of years of in-house experience, we are the partner of choice for many business transformation projects, working with market leaders who are disrupting and driving transformation across every aspect of modern business. Find out why leading technology companies partner with Bits In Glass including Appian (Business Process Management), Pega, MuleSoft (API-Led Systems Integration), and Blue Prism (Robotic Process Automation). We're hiring see a full list of open positions here: https://bit.ly/2U2YTUc

Similar Jobs

Teya Logo Teya

Senior Data Engineer

Fintech • Payments • Financial Services
In-Office
London, Greater London, England, GBR
1000 Employees

Experian Logo Experian

Platform Engineer

Big Data • Marketing Tech • Analytics
Hybrid
Nottingham, Nottinghamshire, England, GBR
16292 Employees

Hyperion Group Logo Hyperion Group

Senior Platform Engineer

Professional Services • Real Estate • Financial Services
In-Office
London, Greater London, England, GBR
3000 Employees
In-Office
London, Greater London, England, GBR
658 Employees

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account