Principal Data Engineer – Enterprise Data Products

Posted 9 Hours Ago
Be an Early Applicant
2 Locations
In-Office or Remote
Expert/Leader
Fintech
The Role
Principal Data Engineer responsible for designing and building scalable enterprise data products using Databricks, Spark, Python, SQL, and lakehouse technologies. The role covers architecture, data ingestion and transformation, cloud integration, testing, CI/CD, observability, data quality, AI-assisted engineering, troubleshooting, prototyping, and modernization. It also requires technical influence through design reviews, coaching, estimation, and collaboration across a distributed engineering team.
Summary Generated by Built In

We are seeking an experienced, hands-on Principal Data Engineer to play a key technical role within our Enterprise Data Products team.
Enterprise Data Products is progressing through a significant technology transformation and rearchitecture. You will join that journey in progress, quickly understand the existing landscape and agreed direction, and get hands-on in helping turn it into effective engineering solutions. We are looking for someone who can add value quickly: bringing deep engineering experience, modern AI-native engineering practices, solving difficult problems, introducing new ideas and constructively challenging approaches where there is a better way. You will be technically curious, pragmatic and comfortable working with evolving or high-level requirements.
 

The Role

This is a senior individual contributor role with no direct people-management responsibility, reporting to the Technical Lead.

You will bring deep technical expertise and hands-on engineering experience across complex delivery, solution design, prototyping and problem solving. Working closely with the Technical Lead and wider engineering team, you will help evaluate technical options, develop pragmatic implementation approaches and turn agreed architectural direction into working solutions.

You will also act as a trusted technical sounding board, supporting engineers through practical collaboration, review, coaching and knowledge sharing across our geographically distributed team.

Key Responsibilities

Solution Architecture & Technical Design

  • Quickly understand the existing platform, architectural direction and transformation roadmap.
  • Contribute hands-on expertise to the implementation and evolution of the target architecture.
  • Develop solution designs and engineering approaches aligned with the agreed technical direction.
  • Evaluate implementation options, balancing scalability, maintainability, performance, cost and delivery.
  • Constructively challenge existing approaches and prototype alternatives where appropriate.
  • Identify technical risks, dependencies and unknowns early and propose pragmatic solutions.

Data Engineering

  • Design and build scalable, resilient and maintainable enterprise data solutions.
  • Apply strong engineering practices using Databricks, Apache Spark/PySpark, Python, SQL and modern lakehouse technologies.
  • Develop reusable patterns for data ingestion, transformation, integration and delivery.
  • Design for incremental processing, schema evolution, reprocessing, performance and cost optimisation.
  • Apply automated testing, CI/CD, observability, data quality, lineage and appropriate engineering controls.
  • Investigate and resolve complex data, integration and platform problems.

AI-Native Engineering

  • Apply AI-native engineering practices across design, coding, testing and troubleshooting to materially improve engineering productivity and effectiveness.
  • Use AI to accelerate the development and maintenance of data solutions, including pipelines, transformations, data models, tests and operational automation.
  • Apply appropriate engineering practices and controls to ensure AI-assisted development is used safely, consistently and effectively.
  • Share practical approaches and learning to help strengthen AI-native engineering capability across the wider team.

Innovation & Continuous Improvement

  • Explore technologies and engineering approaches that could improve Enterprise Data Products.
  • Prototype promising ideas to validate their value and resolve technical unknowns.
  • Identify opportunities to simplify solutions, automate activity and improve engineering effectiveness.
  • Promote technical curiosity, experimentation and continuous improvement while maintaining engineering rigour.

Application & Integration Engineering

  • Apply strong knowledge of modern application, API, authentication and cloud integration patterns.
  • Work across data, application and platform technologies to develop coherent end-to-end solutions.
  • Collaborate with product and engineering teams to translate business needs into practical technical solutions.

Technical Influence & Engineering Support

  • Use technical expertise and hands-on experience to influence engineering decisions and approaches.
  • Act as a technical sounding board for complex or unfamiliar problems.
  • Support engineers through pairing, working examples, code and design reviews, coaching and knowledge sharing.
  • Contribute to pragmatic engineering standards and reusable patterns.
  • Help strengthen capability across a geographically distributed engineering team.
  • Communicate technical options, trade-offs and recommendations clearly.

Estimation & Delivery

  • Turn high-level requirements into technical approaches, identifying dependencies, risks and unknowns.
  • Break complex problems into pragmatic, deliverable increments.
  • Provide credible initial estimates, clearly identifying assumptions and uncertainty.
  • Balance engineering quality, delivery speed, technical risk and long-term maintainability.
Qualifications

What you'll bring

Essential

  • Proven and extensive experience in data engineering 
  • Deep hands-on experience with Databricks across implementation, development, production support and long-term maintenance.
  • Significant experience delivering complex enterprise data engineering solutions.
  • Strong hands-on experience developing production-quality Databricks notebooks using Python and SQL.
  • Demonstrable experience using AI as an integral part of software or data engineering, including design, coding, testing and troubleshooting, with an understanding of the practices and controls required to use it safely and effectively.
  • Strong knowledge of modern data engineering, distributed processing and Lakehouse concepts.
  • Experience with Apache Spark or comparable large-scale data technologies.
  • Experience designing and implementing cloud-based data platforms and products.
  • Strong knowledge of data modelling, ingestion, transformation and integration patterns.
  • Experience with automated testing, source control and CI/CD.
  • Strong troubleshooting and technical problem-solving capability.
  • Experience contributing to technology modernisation, migration or architectural transformation.
  • Ability to turn high-level or evolving requirements into pragmatic solutions and initial estimates.
  • Experience influencing and supporting engineers without direct line-management responsibility.

Desirable

  • Hands-on experience designing and delivering solutions using other lakehouse platforms, such as Microsoft Fabric.
  • Experience with Azure data platforms and cloud services.
  • Experience modernising established enterprise data estates.
  • Experience with data governance, metadata, lineage, observability and data quality.
  • Experience building reusable engineering frameworks or platform capabilities.
  • Experience with modern APIs, integrations and web application technologies.

What we offer
Enjoy a benefits package designed to help you thrive, both professionally and personally. You'll receive 25 days of annual leave plus an extra WTW day to relax and recharge. Our comprehensive health and wellbeing offering includes private healthcare, life insurance, group income protection, and regular health assessments, all giving you peace of mind. Secure your future with our defined contribution pension scheme, featuring matched contributions up to 10% from the company.

We support your growth and balance with hybrid working options, access to an employee assistance programme, and a fully paid volunteer day to make a difference in your community. On top of these, you can opt into a variety of additional perks including an electric vehicle car scheme, share scheme, cycle-to-work programme, dental and optical cover, critical illness protection, and much more. Start making the most of your career and wellbeing with a range of benefits tailored for you.

Equal Opportunity Employer 
We’re committed to equal employment opportunity and provide application, interview and workplace adjustments and accommodations to all applicants. If you foresee any barriers, from the application process through to joining WTW, please email [email protected]
 

Skills Required

  • Proven and extensive experience in data engineering
  • Deep hands-on experience with Databricks across implementation, development, production support, and long-term maintenance
  • Significant experience delivering complex enterprise data engineering solutions
  • Strong hands-on experience developing production-quality Databricks notebooks using Python and SQL
  • Experience using AI as an integral part of software or data engineering, including design, coding, testing, and troubleshooting
  • Understanding of practices and controls for safe and effective AI-assisted development
  • Strong knowledge of modern data engineering, distributed processing, and Lakehouse concepts
  • Experience with Apache Spark or comparable large-scale data technologies
  • Experience designing and implementing cloud-based data platforms and products
  • Strong knowledge of data modelling, ingestion, transformation, and integration patterns
  • Experience with automated testing, source control, and CI/CD
  • Strong troubleshooting and technical problem-solving capability
  • Experience contributing to technology modernisation, migration, or architectural transformation
  • Ability to turn high-level or evolving requirements into pragmatic solutions and initial estimates
  • Experience influencing and supporting engineers without direct line-management responsibility
  • Hands-on experience designing and delivering solutions using other lakehouse platforms, such as Microsoft Fabric
  • Experience with Azure data platforms and cloud services
  • Experience modernising established enterprise data estates
  • Experience with data governance, metadata, lineage, observability, and data quality
  • Experience building reusable engineering frameworks or platform capabilities
  • Experience with modern APIs, integrations, and web application technologies

Willis Towers Watson Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Willis Towers Watson and has not been reviewed or approved by Willis Towers Watson.

  • Retirement Support — Retirement programs include a 401(k) with an additional company-funded contribution, and some roles retain eligibility for a contributory pension. This dual DC/DB design is positioned as a standout element of the package.
  • Healthcare Strength — Health and protection offerings span multiple medical plan choices, dental, vision, HSA/FSA, and company‑paid basic life/AD&D with optional add‑ons like legal and identity protection. Wellbeing resources and an EAP are part of the standard package.
  • Strong & Reliable Incentives — Annual bonuses are commonly part of total compensation with a regular cadence noted across many roles. This helps bolster overall pay even when base salary is viewed as mid‑market.

Willis Towers Watson Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
41,317 Employees

What We Do

Willis Towers Watson (NASDAQ: WLTW ) is a leading global advisory, broking and solutions company that helps clients around the world turn risk into a path for growth. With roots dating to 1828, Willis Towers Watson has more than 45,000 employees serving more than 140 countries and markets. We design and deliver solutions that manage risk, optimize benefits, cultivate talent, and expand the power of capital to protect and strengthen institutions and individuals. Our unique perspective allows us to see the critical intersections between talent, assets and ideas — the dynamic formula that drives business performance.

Similar Jobs

TransUnion Logo TransUnion

Customer Service Incident Coordinator - Arabic & French

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Remote or Hybrid
United Kingdom
13000 Employees

CSC Logo CSC

Senior Vendor Management Specialist

Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Remote or Hybrid
3 Locations
8500 Employees

CSC Logo CSC

Associate Vendor Management Specialist

Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Remote or Hybrid
4 Locations
8500 Employees

Airwallex Logo Airwallex

Senior Manager, Financial Crime Compliance, Suspicious Activity Reporting

Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
In-Office or Remote
Birmingham, West Midlands, England, GBR
2700 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account