Lead Data Platform Engineer

Posted 3 Days Ago
Be an Early Applicant
Hyderabad, Telangana, IND
Hybrid
Senior level
Big Data • Marketing Tech • Analytics
The Role
Lead hands-on data platform engineering: design and optimize AWS-native data lake architectures using a data mesh model, build data pipelines, implement IaC (Terraform), CI/CD, automated testing, monitoring and data quality frameworks, mentor engineers, and collaborate with stakeholders to deliver scalable, reliable data solutions.
Summary Generated by Built In
Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com

Job Description

We are seeking a Lead Data Platform Engineer to act as a hands-on technical leader for our data platform engineering function.

You will be #LI-hybrid based in Hyderabad and reporting to Director Engineering

You will be responsible for designing, building scalable data platforms while driving engineering best practices across the team.

You will help shape our AWS-native data ecosystem, mentor engineers, and ensure the delivery of high-quality, reliable data solutions.

Key Responsibilities

  • Be a hands-on technical lead across data engineering workstreams, setting direction and standards
  • You will Design, build, and optimise data lake architectures using a data mesh model
  • Develop and maintain AWS-native data platforms using modern cloud services
  • Implement DevOps best practices, including Infrastructure-as-Code (IaC) using Terraform and CI/CD pipelines
  • Apply configuration-as-code principles consistently across all environments.
  • Embed automated testing, monitoring, and data quality frameworks into the development lifecycle
  • Provide guidance, and mentoring to engineers within the team
  • Collaborate with cross-functional stakeholders to deliver robust and scalable data solutions
  • Troubleshoot and optimize data workflows to ensure performance, reliability, and scalability

 

Qualifications

  • 8+ years of relevant experience in Data Platform engineering
  • Proven experience at Lead or Principal Engineer level within a large or enterprise environment
  • Extensive hands-on experience with AWS data services, including:
    • Glue
    • Step Functions
    • Lake Formation
    • EventBridge
    • Lambda
    • Datazone
    • Cloudwatch
  • Strong experience designing and building data pipelines and data lake solutions
  • Solid DevOps expertise, including:
    • Terraform (Infrastructure-as-Code)
    • CI/CD pipelines
    • Git and Jenkins
  • Working knowledge of AWS SageMaker Unified Studio
  • Advanced programming skills in Python
  • Experience with API integrations and configuration-as-code approaches
  • Investigate and reconcile complex workflows
  • Proven experience implementing automated testing frameworks within data engineering workflows

Desirable Attributes

  • Continuous improvement and Innovation
  • Experience working in agile delivery environments
  • Passion for mentoring and developing engineering talent

Additional Information

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Global Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site and Glassdoor to understand why.

 

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is a critical part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, color, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

 

Benefits

 

Experian care for employee's work life balance, health, safety and wellbeing. In support of this endeavor, we offer best-in-class family well-being benefits, enhanced medical benefits and paid time off.

This is a hybrid remote/in-office role.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here

Skills Required

  • 8+ years of relevant experience in Data Platform engineering
  • Proven experience at Lead or Principal Engineer level within a large or enterprise environment
  • Extensive hands-on experience with AWS data services (Glue, Step Functions, Lake Formation, EventBridge, Lambda, Datazone, CloudWatch)
  • Strong experience designing and building data pipelines and data lake solutions
  • DevOps expertise including Terraform (IaC), CI/CD pipelines, Git and Jenkins
  • Working knowledge of AWS SageMaker Unified Studio
  • Advanced programming skills in Python
  • Experience with API integrations and configuration-as-code approaches
  • Ability to investigate and reconcile complex workflows
  • Proven experience implementing automated testing frameworks within data engineering workflows
  • Experience working in agile delivery environments
  • Passion for mentoring and developing engineering talent

Experian Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Experian and has not been reviewed or approved by Experian.

  • Healthcare Strength Medical and dental coverage is described as strong, with expanded mental health resources and telemedicine options. Coverage includes inclusive services such as gender transition and fertility support.
  • Leave & Time Off Breadth Time-off offerings are generous, including substantial PTO/vacation, paid holidays, and paid volunteer days with options to purchase additional leave. Parental leave is available for birth and non-birth parents alongside flexible working arrangements that support work-life balance.
  • Retirement Support Retirement programs include a 401(k) with company matching and contributory pension schemes in some regions. These elements complement base pay and bonuses to form a competitive total rewards package.

Experian Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dublin
16,292 Employees
Year Founded: 1980

What We Do

Experian unlocks the power of data to create opportunities for consumers, businesses and society. During life’s big moments – from buying a home or car, to sending a child to college, to growing a business exponentially by connecting it with new customers – we empower consumers and our clients to manage data with confidence so they can maximize every opportunity. We gather, analyse and process data in ways others can’t. We help individuals take financial control and access financial services, businesses make smarter decision and thrive, lenders lend more responsibly, and organizations prevent identity fraud and crime. For more than 125 years, we’ve helped consumers and clients prosper, and economies and communities flourish – and we’re not done. Our 20,600 people in 43 countries believe the possibilities for you, and our world, are growing. We’re investing in new technologies, talented people and innovation so we can help create a better tomorrow. About Experian: Bringing data to life requires creativity, passion, flexibility and expertise. We want you to share in our success. That's why we offer rewards that recognise great performance. Working in a culture of collaboration, achievement and respect we will give you the support and encouragement you need to develop your skills and talents and progress your career. Everyday our people bring enthusiasm, innovation and inspiration to work and if this sounds like you connect with us at Experian.

Similar Jobs

In-Office
Hyderabad, Telangana, IND
115 Employees

Vertafore Logo Vertafore

Senior Software Engineer

Information Technology • Insurance • Software
Hybrid
Hyderabad, Telangana, IND
2372 Employees

Optum Logo Optum

Machine Learning Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Machine Learning Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Similar Companies Hiring

Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account