Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.
We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.
We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.
Job Description- Senior Data Engineer is responsible for design, develop and support ETL data pipelines solutions primary in AWS environment
- Design, develop, and maintain scaled ETL process to deliver meaningful insights from large and complicated data sets.
- Work as part of a team to build out and support data warehouse, implement solutions using PySpark to process structured and unstructured data.
- Play key role in building out a semantic layer through development of ETLs and virtualized views.
- Collaborate with Engineering teams to discovery and leverage new data being introduced into the environment
- Support existing ETL processes written in SQL, or leveraging third party APIs with Python, troubleshoot and resolve production issues.
- Strong SQL and data to understand and troubleshoot existing complex SQL.
- Hands-on experience with Apache Airflow or equivalent tools (AWS MWAA) for orchestration of data pipelines
- Create and maintain report specifications and process documentations as part of the required data deliverables.
- Serve as liaison with business and technical teams to achieve project objectives, delivering cross functional reporting solutions.
- Troubleshoot and resolve data, system, and performance issues
- Communicating with business partners, other technical teams and management to collect requirements, articulate data deliverables, and provide technical designs.
- you have completed graduation from BE/Btech
- 6 to 9 years of experience in Data Engineering development
- 5 years of experience in Python scripting
- You should have 8 years experience in SQL, 5+years in Datawarehouse, 5yrs in Agile and 3yrs with Cloud
- 3 years of experience with AWS ecosystem (Redshift, EMR, S3, MWAA)
- 5 years of experience in Agile development methodology
- You will work with the team to create solutions
- Proficiency in CI/CD tools (Jenkins, GitLab, etc.)
Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.
#LI-Onsite
Benefits
Experian care for employee's work life balance, health, safety and wellbeing.
1) In support of this endeavor, we offer the best family well-being benefits,
2) Enhanced medical benefits and paid time off.
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here
Top Skills
What We Do
Experian unlocks the power of data to create opportunities for consumers, businesses and society.
During life’s big moments – from buying a home or car, to sending a child to college, to growing a business exponentially by connecting it with new customers – we empower consumers and our clients to manage data with confidence so they can maximize every opportunity.
We gather, analyse and process data in ways others can’t. We help individuals take financial control and access financial services, businesses make smarter decision and thrive, lenders lend more responsibly, and organizations prevent identity fraud and crime.
For more than 125 years, we’ve helped consumers and clients prosper, and economies and communities flourish – and we’re not done.
Our 20,600 people in 43 countries believe the possibilities for you, and our world, are growing. We’re investing in new technologies, talented people and innovation so we can help create a better tomorrow.
About Experian:
Bringing data to life requires creativity, passion, flexibility and expertise.
We want you to share in our success. That's why we offer rewards that recognise great performance.
Working in a culture of collaboration, achievement and respect we will give you the support and encouragement you need to develop your skills and talents and progress your career.
Everyday our people bring enthusiasm, innovation and inspiration to work and if this sounds like you connect with us at Experian.
