Senior Data Platform Engineer AWS, Spark

Posted 2 Days Ago
Be an Early Applicant
Nottingham, Nottinghamshire, England, GBR
Hybrid
Senior level
Big Data • Marketing Tech • Analytics
The Role
Provides hands-on technical leadership for a fraud data platform. Designs, builds, tests, and maintains AWS data pipelines; develops ingestion, transformation, integrations, and automation; and applies Infrastructure as Code, CI/CD, DevSecOps, security, governance, and compliance practices. The role contributes to technical designs, documentation, operational support, roadmap discussions, and mentoring junior engineers while delivering scalable, secure, and supportable data platform solutions.
Summary Generated by Built In
Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries.

Internal Grade D/EB8

Job Description

Experian Credit Services & Verifications are looking for a Senior Data Platform Engineer to provide hands-on technical leadership for a new fraud data capability that will connect fraud-related data assets into Experian's Data Analytics Platform.

You will work closely with the central Data Analytics Platform team, data owners, security, compliance, platform and delivery stakeholders to agree practical implementation approaches, align with established platform patterns, and ensure the team delivers secure, scalable and supportable solutions.

This is a hands-on engineering role suited to someone who can combine strong data engineering depth with cloud platform experience, engineering discipline and team leadership. You will apply effective DevSecOps practices and contribute to technical roadmap discussions where you will make effective use of CI/CD, Infrastructure as Code and cloud-native tooling, and help drive automation and continuous improvement across the engineering lifecycle.

This is a Hybrid, Nottingham based role (40% in the office) reporting to the Director of Engineering.

Key responsibilities

  • Design, build, test and maintain AWS-based data pipelines for fraud-related data assets.
  • Support ingestion and transformation of data from source platforms such as Snowflake and internal product/data systems.
  • Develop new data flows, integrations and automation as additional data assets are onboarded.
  • Work with platform, security and data stakeholders to ensure solutions follow agreed security, governance and compliance patterns.
  • Contribute to technical design discussions, review proposals, evaluate options, provide estimates and recommend practical solutions.
  • Use Infrastructure as Code and Configuration as Code tooling, such as Terraform, Git and CI/CD pipelines, to deliver repeatable solutions.
  • Produce clear documentation covering pipelines, data flows, operational procedures and support processes.
  • Support junior engineers where appropriate and contribute to a collaborative, quality-focused engineering culture.
  • Use modern engineering practices, including automation and AI-assisted development where appropriate, to improve delivery speed, quality and repeatability.

Qualifications

  • Strong experience building data pipelines, data lake solutions or data platform capabilities.
  • Strong experience with AWS cloud services relevant to data engineering and platform delivery, including services such as AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.
  • Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.
  • Strong experience developing on Apache Spark or Hadoop.
  • Significant programming experience using Scala or Python.
  • Strong understanding of cloud security, data privacy, access control and governance principles in data platform environments

Desired skills

  • AWS Developer Certification or other relevant AWS certification.
  • Strong expertise in Terraform or CloudFormation.
  • Experience with OpenShift or Kubernetes.
  • Experience with automated testing tools such as pytest or Scalatest.
  • Knowledge of RESTful APIs and microservice architectures.
  • Experience working with sensitive, governed or regulated data environments.
  • Familiarity with data catalogue, metadata management, data marketplace or federated data mesh concepts.

Additional Information

  • Great compensation package and discretionary bonus plan
  • Core benefits include pension, bupa healthcare, sharesave scheme and more
  • 25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.

Recruitment Fraud Awareness - Experian's recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @experian.com email address. Experian will never ask candidates to make any payment as part of an application, interview, assessment, onboarding, or recruitment process. To apply for roles or verify opportunities, please visit experian.com/careers.

Our uniqueness is that we celebrate yours. Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces™ 2025 (Fortune Global Top 25), Great Place To Work™ in 26 countries to name a few. Check out Experian Life on social or explore our Careers Site to understand why. Experian is also proud to be an Equal Opportunity and Affirmative Action employer. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here

Skills Required

  • Strong experience building data pipelines, data lake solutions, or data platform capabilities
  • Strong experience with AWS cloud services including AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge, and SQS
  • Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git, and Jenkins
  • Strong experience developing with Apache Spark or Hadoop
  • Significant programming experience using Scala or Python
  • Strong understanding of cloud security, data privacy, access control, and governance principles in data platform environments
  • AWS Developer Certification or another relevant AWS certification
  • Strong expertise in Terraform or CloudFormation
  • Experience with OpenShift or Kubernetes
  • Experience with automated testing tools such as pytest or ScalaTest
  • Knowledge of RESTful APIs and microservice architectures
  • Experience working with sensitive, governed, or regulated data environments
  • Familiarity with data catalogs, metadata management, data marketplaces, or federated data mesh concepts

Experian Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Experian and has not been reviewed or approved by Experian.

  • Healthcare Strength — Medical and dental coverage is described as strong, with expanded mental health resources and telemedicine options. Coverage includes inclusive services such as gender transition and fertility support.
  • Leave & Time Off Breadth — Time-off offerings are generous, including substantial PTO/vacation, paid holidays, and paid volunteer days with options to purchase additional leave. Parental leave is available for birth and non-birth parents alongside flexible working arrangements that support work-life balance.
  • Retirement Support — Retirement programs include a 401(k) with company matching and contributory pension schemes in some regions. These elements complement base pay and bonuses to form a competitive total rewards package.

Experian Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dublin
16,292 Employees
Year Founded: 1980

What We Do

Experian unlocks the power of data to create opportunities for consumers, businesses and society. During life’s big moments – from buying a home or car, to sending a child to college, to growing a business exponentially by connecting it with new customers – we empower consumers and our clients to manage data with confidence so they can maximize every opportunity. We gather, analyse and process data in ways others can’t. We help individuals take financial control and access financial services, businesses make smarter decision and thrive, lenders lend more responsibly, and organizations prevent identity fraud and crime. For more than 125 years, we’ve helped consumers and clients prosper, and economies and communities flourish – and we’re not done. Our 20,600 people in 43 countries believe the possibilities for you, and our world, are growing. We’re investing in new technologies, talented people and innovation so we can help create a better tomorrow. About Experian: Bringing data to life requires creativity, passion, flexibility and expertise. We want you to share in our success. That's why we offer rewards that recognise great performance. Working in a culture of collaboration, achievement and respect we will give you the support and encouragement you need to develop your skills and talents and progress your career. Everyday our people bring enthusiasm, innovation and inspiration to work and if this sounds like you connect with us at Experian.

Similar Jobs

Mondelēz International Logo Mondelēz International

Designer

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Hybrid
Birmingham, West Midlands, England, GBR
90000 Employees

Hiya Inc. Logo Hiya Inc.

Customer Success Manager

Artificial Intelligence • Cloud • Mobile • Security • Software
Hybrid
London, Greater London, England, GBR
150 Employees

ServiceNow Logo ServiceNow

Forward Deployed Solution Engineer – Applied AI FDE

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
London, Greater London, England, GBR
29000 Employees

Wise Logo Wise

Senior Software Engineer

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
London, Greater London, England, GBR
9000 Employees
87K-111K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account