Senior Data Engineer, Director

Posted 2 Days Ago
Be an Early Applicant
3 Locations
In-Office
Senior level
Fintech • Payments • Financial Services
The Role
Design, build, and maintain scalable data pipelines, ETL processes, and data architectures (lakes, warehouses). Develop real-time streaming apps (Spark Streaming, Flink), optimize Spark performance, ensure data quality, governance, and security, integrate AI/ML pipelines, evaluate new data technologies, troubleshoot pipeline performance, and mentor junior engineers.
Summary Generated by Built In

Join us as a Senior Data Engineer

  • We’ll look to you to drive the build of effortless, digital-first customer experiences as you simplify our bank while keeping our data safe and secure
  • Day-to-day, you’ll develop innovative, data-driven solutions through data pipeline modelling and ETL design, inspiring to be commercially successful through insights
  • This is your opportunity to explore your leadership potential while bringing a competitive edge to your career profile by solving problems and creating smarter solutions
  • We're offering this role at director level
What you’ll do

In this role, you’ll design, build and maintaining scalable data pipelines and architectures. The ideal candidate will have strong expertise in handling large data sets, optimising data flows, and collaborating closely with data scientists, analysts, and other engineering teams to enable data-driven decision-making.

We’ll look to you to design, develop, and maintain scalable data pipelines and ETL processes to support analytics and reporting requirements, while building and optimizing data architectures including data lakes, data warehouses, and databases. You'll develop and support real-time data streaming applications using Apache Spark Streaming and Apache Flink, perform Spark performance tuning for large-scale data processing, and collaborate closely with data scientists and analysts to deliver clean, reliable, and high-quality datasets.

You’ll also be responsible for:

  • Driving customer value by understanding complex business problems and requirements to correctly apply the most appropriate and reusable tools to gather and build data solutions
  • Ensureing data quality, integrity, and security across all data platforms.
  • Implementing best practices for data governance and compliance.
  • Monitoring and troubleshooting data pipeline performance and resolve data-related issues proactively.
  • Evaluating and integrating new data technologies and tools to enhance data processing capabilities, with a focus on AI tools and concepts.
  • Collaborating with cross-functional teams to support data-driven initiatives.
  • Mentoring and guiding junior data engineers and team members.
The skills you’ll need

We’re looking for someone with strong communication skills and the ability to proactively engage and manage a wide range of stakeholders. You'll need at least twelve years of professional experience as a Data Engineer or in a similar role, with strong expertise in Apache Spark including Spark Streaming and performance optimization, Scala, Python, and Apache Flink for real-time data processing. You'need expertise in AI concepts and tools within data engineering workflows, build high-performance data APIs using FastAPI, and working extensively with AWS services such as EMR, Kinesis, DynamoDB, Athena, and QuickSight.

You'll need hands-on experience with data lake technologies and formats including Parquet and Apache Iceberg, containerization platforms such as Docker and Podman, and relational databases including PostgreSQL and Hive, supported by strong SQL skills. You'll also contribute to machine learning pipeline integration, ensure compliance with GDPR and other data privacy regulations, and hold a Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field.

You’ll also need:

  • Expertise in ETL tools and frameworks and data pipeline orchestration.
  • Strong understanding of cloud data platforms and services.
  • Knowledge of data modelling, schema design, and data architecture principles.
  • Familiarity with data security standards and compliance requirements.
  • Experience with DevOps, CI/CD pipelines, and container orchestration like Kubernetes
  • An understanding of modern code development practices

Hours

45

Job Posting Closing Date:

24/08/2026

Skills Required

  • Minimum 12 years professional experience as a Data Engineer or similar role
  • Strong expertise in Apache Spark including Spark Streaming and performance optimization
  • Experience with Apache Flink for real-time data processing
  • Proficiency in Scala and Python
  • Experience building high-performance data APIs using FastAPI
  • Hands-on experience with AWS data services (EMR, Kinesis, DynamoDB, Athena, QuickSight)
  • Experience with data lake formats and technologies including Parquet and Apache Iceberg
  • Containerization experience with Docker and Podman
  • Experience with relational and analytic databases (PostgreSQL, Hive) and strong SQL skills
  • Expertise in ETL tools/frameworks and data pipeline orchestration
  • Experience with DevOps practices, CI/CD pipelines, and container orchestration (Kubernetes)
  • Familiarity with AI concepts and tools integrated into data engineering workflows
  • Knowledge of data governance, GDPR, and data privacy/compliance requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or related field

NatWest Group Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NatWest Group and has not been reviewed or approved by NatWest Group.

  • Flexible Benefits A flexible ValueAccount structure with pension and benefit funding allows tailoring of health, protection, lifestyle, and savings options, with unused amounts typically paid as cash. This flexibility supports personalisation of coverage, particularly in Great Britain where the framework is most detailed.
  • Retirement Support Employer-funded pension contributions are provided on top of salary in Great Britain, alongside automatic retirement enrollment and share/save programs. This creates structured long‑term wealth support as part of total reward.
  • Parental & Family Support UK policies outline extended maternity, adoption and equal partner leave on full pay with a phased return, plus paid neonatal care leave. These provisions are positioned as market‑leading and complement broader flexibility resources.

NatWest Group Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Edinburgh
40,000 Employees
Year Founded: 1970

What We Do

We’re a business that understands when our customers and people succeed, our communities succeed, and our economy thrives. As part of our purpose, we’re looking at how we can drive change for our communities in enterprise, learning and climate. As one of the leading supporters of UK business, we’re prioritising enterprise as a force of change. We’re focusing on the people and communities who have traditionally faced the highest barriers to entry and figuring out ways to remove these. Learning is also key to our continued growth as a company in an ever changing and increasingly digital world. By setting a dynamic and leading learning culture, our people prosper, and our customers are given the tools to continue to improve their financial capability and confidence. One of the biggest challenges we all face in our future is climate change. That’s why we’ve put it right at the core of our purpose. We want to champion climate solutions with financing and entrepreneurial support, fully embed climate into our culture and decision making, and be climate positive by 2025. We’re committed to using our purpose to break down barriers, drive change and ultimately create a great place to work.

Similar Jobs

Capco Logo Capco

GCB 5-PMO

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Cloudflare Logo Cloudflare

Senior Manager, Customer Engineering, India

Cloud • Information Technology • Security • Software • Cybersecurity
Remote or Hybrid
India
4400 Employees

Mondelēz International Logo Mondelēz International

Controller

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
India
90000 Employees

McCain Foods Logo McCain Foods

Business Development Executive Retail - Chennai

Food • Retail • Agriculture • Manufacturing
In-Office
Chennai, Tamil Nadu, IND
20000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account