Senior Data Engineer

Sorry, this job was removed at 02:25 p.m. (UTC) on Tuesday, Aug 11, 2026
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Big Data • Marketing Tech • Analytics
The Role
Develop, optimize, and maintain batch data pipelines using Scala and Spark on AWS. Collaborate with engineers and analysts, ensure data integrity, participate in code reviews, and troubleshoot production pipelines. Support DevOps, IaC, and data lake/ETL architectures.
Summary Generated by Built In
Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries. 

Our uniqueness is that we celebrate yours. Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces™ 2025 (Fortune Global Top 25), Great Place To Work™ in 26 countries to name a few.

Check out Experian Life on social or explore our Careers Site (experian.com/careers) to understand why.

Job Description

We are looking for Data Engineer - Scala. This is a hybrid role requiring travelling to Hyderabad office 40% per month.

Main responsibilities:

  • You will be #LI-hybrid based in Hyderabad and reporting to Director Engineering.
  • Develop and maintain batch data processing pipelines using Scala and Apache Spark
  • Optimize Spark workloads for performance and scalability in an AWS cloud environment.
  • You will partner with data engineers and analysts to understand data needs and deliver high-quality data solutions.
  • Ensure data integrity, reliability, and consistency across systems.
  • Participate in code reviews, technical design discussions, and Agile development activities.
  • Monitor and troubleshoot production data pipelines and support issue resolution

Qualifications

  • 3-6 years of software development experience, including at least 2 years working with Scala.
  • Experience writing clean, scalable, and reusable code using SOLID principles, coding standards, and common design patterns where appropriate.
  • Understanding of functional programming concepts and distributed computing.
  • Experience with DevOps and Infrastructure as Code (IaC) tools, including Terraform, CI/CD pipelines, Git, and Jenkins.
  • Hands-on experience using Apache Spark for batch data processing.
  • Familiarity with AWS services such as Amazon S3, AWS Glue, AWS Lambda, AWS Step Functions, AWS Batch, and CloudWatch.
  • Experience working with structured and semi-structured data formats, including Parquet and JSON.
  • Experience across the full software development lifecycle and application lifecycle management tools such as Bitbucket and Jira.
  • Experience with data lake architectures and ETL frameworks.
  • Exposure to containerization technologies such as Docker and Kubernetes.
  • Knowledge of data governance and data security best practices.
  • Relevant certifications in AWS, Spark, or Scala will be an advantage.

Additional Information

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Global Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site and Glassdoor to understand why.

Experian is also proud to be an Equal Opportunity and Affirmative Action employer. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Recruitment Fraud Awareness - Experian's recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @experian.com email address. Experian will never ask candidates to make any payment as part of an application, interview, assessment, onboarding, or recruitment process. To apply for roles or verify opportunities, please visit experian.com/careers.

 

 

Benefits

 

Experian care for employee's work life balance, health, safety and wellbeing. In support of this endeavor, we offer best-in-class family well-being benefits, enhanced medical benefits and paid time off.

This is a hybrid remote/in-office role.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here

Skills Required

  • 3-6 years of software development experience
  • At least 2 years working with Scala
  • Experience with Apache Spark for batch data processing
  • Experience with Terraform (IaC)
  • Experience with CI/CD pipelines
  • Experience with Git
  • Experience with Jenkins
  • Familiarity with AWS services (Amazon S3, AWS Glue, AWS Lambda, AWS Step Functions, AWS Batch, CloudWatch)
  • Experience with Parquet and JSON data formats
  • Experience with data lake architectures and ETL frameworks
  • Experience across full SDLC and ALM tools (Bitbucket, Jira)
  • Understanding of functional programming concepts and distributed computing
  • Experience writing clean, scalable code using SOLID principles
  • Exposure to containerization technologies such as Docker and Kubernetes
  • Relevant certifications in AWS, Spark, or Scala

Experian Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Experian and has not been reviewed or approved by Experian.

  • Healthcare Strength Medical and dental coverage is described as strong, with expanded mental health resources and telemedicine options. Coverage includes inclusive services such as gender transition and fertility support.
  • Leave & Time Off Breadth Time-off offerings are generous, including substantial PTO/vacation, paid holidays, and paid volunteer days with options to purchase additional leave. Parental leave is available for birth and non-birth parents alongside flexible working arrangements that support work-life balance.
  • Retirement Support Retirement programs include a 401(k) with company matching and contributory pension schemes in some regions. These elements complement base pay and bonuses to form a competitive total rewards package.

Experian Insights

Similar Jobs

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

ServiceNow Logo ServiceNow

Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Hyderabad, Telangana, IND
29000 Employees

Coursera + Udemy  Logo Coursera + Udemy

Senior Data Engineer

Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Remote or Hybrid
India
1500 Employees

Optum Logo Optum

Senior Software Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dublin
16,292 Employees
Year Founded: 1980

What We Do

Experian unlocks the power of data to create opportunities for consumers, businesses and society. During life’s big moments – from buying a home or car, to sending a child to college, to growing a business exponentially by connecting it with new customers – we empower consumers and our clients to manage data with confidence so they can maximize every opportunity. We gather, analyse and process data in ways others can’t. We help individuals take financial control and access financial services, businesses make smarter decision and thrive, lenders lend more responsibly, and organizations prevent identity fraud and crime. For more than 125 years, we’ve helped consumers and clients prosper, and economies and communities flourish – and we’re not done. Our 20,600 people in 43 countries believe the possibilities for you, and our world, are growing. We’re investing in new technologies, talented people and innovation so we can help create a better tomorrow. About Experian: Bringing data to life requires creativity, passion, flexibility and expertise. We want you to share in our success. That's why we offer rewards that recognise great performance. Working in a culture of collaboration, achievement and respect we will give you the support and encouragement you need to develop your skills and talents and progress your career. Everyday our people bring enthusiasm, innovation and inspiration to work and if this sounds like you connect with us at Experian.

Similar Companies Hiring

Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account