Data Engineer – Python, PySpark & AWS, AVP

Posted Yesterday
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Fintech • Payments • Financial Services
The Role
Build and support enterprise-scale data pipelines, streaming ingestion, ETL/ELT frameworks, data warehouses, and scalable data architectures. Develop Python and PySpark solutions, optimize PostgreSQL and AWS services, automate pipelines, ensure data quality, and translate business requirements into secure integration designs. Lead complex engineering initiatives, contribute to Agile delivery, mentor colleagues, and provide production troubleshooting and root-cause analysis.
Summary Generated by Built In

Join us as a Data Engineer


  • We’re looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secure
  • Day-to-day, you’ll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insights
  • If you’re ready for a new challenge, and want to bring a competitive edge to your career profile by delivering streaming data ingestions, this could be the role for you
  • We're offering this role at associate vice president level

What you’ll do

Your daily responsibilities will include you developing a comprehensive knowledge of our data structures and metrics, advocating for change when needed for product development. You’ll also provide transformation solutions and carry out complex data extractions.


We’ll expect you to develop a clear understanding of data platform cost levels to build cost-effective and strategic solutions. You’ll also source new data by using the most appropriate tooling before integrating it into the overall solution to deliver it to our customers.


You’ll also be responsible for:


  • Driving customer value by understanding complex business problems and requirements to correctly apply the most appropriate and reusable tools to build data solutions
  • Participating in the data engineering community to deliver opportunities to support our strategic direction
  • Carrying out complex data engineering tasks to build a scalable data architecture and the transformation of data to make it usable to analysts and data scientists
  • Building advanced automation of data engineering pipelines through the removal of manual stages
  • Leading on the planning and design of complex products and providing guidance to colleagues and the wider team when required

The skills you’ll need

To be successful in this role, you’ll have an understanding of data usage and dependencies with wider teams and the end customer. You’ll also have experience of extracting value and features from large scale data.


We’ll expect you to have experience of ETL technical design, data quality testing, cleansing and monitoring, data sourcing, exploration and analysis, and data warehousing and data modelling capabilities.


You’ll also need:


  • At least eight years of experience building and supporting enterprise-scale data pipelines and analytics solutions using advanced Python and PySpark for large-scale batch and real-time processing
  • Strong experience in data warehousing, including dimensional modelling, star and snowflake schemas, fact and dimension design, SCD, ETL/ELT frameworks, data lake and data warehouse architectures, data quality and governance
  • Strong expertise in PostgreSQL database design, optimisation and query tuning, along with AWS services including S3, Glue, EMR, Lambda, RDS, ECS/EKS, CloudWatch, IAM and API Gateway
  • Experience translating business requirements into HLD/LLD documents and designing secure, scalable and resilient integration patterns for enterprise applications and data platforms
  • Experience with CI/CD pipelines, multi-environment release management, automated testing and production troubleshooting with root-cause analysis
  • Strong Agile delivery experience with Product Owners, Architects and business stakeholders, including Jira, sprint planning, estimation, backlog grooming and retrospectives, with exposure to AI-assisted development tools such as Kiro and Copilot and mentoring engineers as an advantage

Hours

45

Job Posting Closing Date:

23/11/2026

Skills Required

  • At least eight years of experience building and supporting enterprise-scale data pipelines and analytics solutions
  • Advanced Python and PySpark experience for large-scale batch and real-time processing
  • Experience with data warehousing, dimensional modelling, star and snowflake schemas, fact and dimension design, SCD, ETL/ELT frameworks, data lakes, data warehouses, data quality, and governance
  • Strong PostgreSQL database design, optimization, and query tuning experience
  • Experience with AWS S3, Glue, EMR, Lambda, RDS, ECS/EKS, CloudWatch, IAM, and API Gateway
  • Experience translating business requirements into HLD and LLD documents
  • Experience designing secure, scalable, and resilient integration patterns for enterprise applications and data platforms
  • Experience with CI/CD pipelines, multi-environment release management, automated testing, and production troubleshooting with root-cause analysis
  • Strong Agile delivery experience with Product Owners, Architects, and business stakeholders
  • Experience with Jira, sprint planning, estimation, backlog grooming, and retrospectives
  • Exposure to AI-assisted development tools such as Kiro and Copilot
  • Experience mentoring engineers

NatWest Group Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NatWest Group and has not been reviewed or approved by NatWest Group.

  • Flexible Benefits — A flexible ValueAccount structure with pension and benefit funding allows tailoring of health, protection, lifestyle, and savings options, with unused amounts typically paid as cash. This flexibility supports personalisation of coverage, particularly in Great Britain where the framework is most detailed.
  • Retirement Support — Employer-funded pension contributions are provided on top of salary in Great Britain, alongside automatic retirement enrollment and share/save programs. This creates structured long‑term wealth support as part of total reward.
  • Parental & Family Support — UK policies outline extended maternity, adoption and equal partner leave on full pay with a phased return, plus paid neonatal care leave. These provisions are positioned as market‑leading and complement broader flexibility resources.

NatWest Group Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Edinburgh
40,000 Employees
Year Founded: 1970

What We Do

We’re a business that understands when our customers and people succeed, our communities succeed, and our economy thrives. As part of our purpose, we’re looking at how we can drive change for our communities in enterprise, learning and climate. As one of the leading supporters of UK business, we’re prioritising enterprise as a force of change. We’re focusing on the people and communities who have traditionally faced the highest barriers to entry and figuring out ways to remove these. Learning is also key to our continued growth as a company in an ever changing and increasingly digital world. By setting a dynamic and leading learning culture, our people prosper, and our customers are given the tools to continue to improve their financial capability and confidence. One of the biggest challenges we all face in our future is climate change. That’s why we’ve put it right at the core of our purpose. We want to champion climate solutions with financing and entrepreneurial support, fully embed climate into our culture and decision making, and be climate positive by 2025. We’re committed to using our purpose to break down barriers, drive change and ultimately create a great place to work.

Similar Jobs

Mondelēz International Logo Mondelēz International

Platform Engineer

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
India
90000 Employees

Zscaler Logo Zscaler

Account Executive

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Hybrid
Bangalore, Bengaluru, Karnataka, IND
8697 Employees

BlackRock Logo BlackRock

Managing Director, Global Head of Derived Data

Fintech • Information Technology • Financial Services
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
25000 Employees

Zscaler Logo Zscaler

Development Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Hybrid
Bangalore, Bengaluru, Karnataka, IND
8697 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account