Senior Data Engineer - Chennai/Banglore/Hyderabad/Trivandrum, India

Posted 7 Days Ago
Be an Early Applicant
Chennai, Tamil Nadu, IND
In-Office
Senior level
Agency • Information Technology
The Role
Design, build, and optimize ELT data pipelines using Python, Airflow DAGs, and Spark in cloud environments. Convert and debug Microsoft BI ETLs into scalable big-data workflows, tune Spark resources, collaborate with business partners, and participate in Agile ceremonies with Pacific-time overlap.
Summary Generated by Built In
Greetings Everyone

 

 

 

Who are we? 

For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check https://youtu.be/uJWBWQZEA6o.



 

What will you do?     What are we looking for? 

Technical Skill set:
Having 3-5 years of experience in implementing Big Data solution in Cloud environments.
Hands-on in implenting Big data solution using Airflow DAG,Spark,Python,Hive,Trino,S3 Bucket,etc
Having experience Cloud Data platform like SnowFlake , Databricks is a plus.
Knowledge of Financial domain-Credit Card industry is a plus. 
Responsibilites:
Creating an ELT Data pipelines using python script and Airflow DAG.
Optimizing the Data pipelines by configuring the Spark system resources 
Debug an existing Microsoft BI ETLs and understand business logic and convert in to big data pipeline using Airflow DAG.
Able to interact with business partners to understand the requirements and provide technical solutions.
Proficient with Agile Methodology and active team participation is required.

Need to have overlap with Onsite team till 10-11 am Pacific time , for attending scrum ceremonies or to have onsite interaction .

Location : Offshore

Skills Required

  • 3-5 years implementing Big Data solutions in cloud environments
  • Hands-on experience with Airflow (DAGs)
  • Hands-on experience with Spark
  • Proficient in Python for data pipelines
  • Experience with Hive
  • Experience with Trino
  • Experience working with S3 buckets (cloud object storage)
  • Experience creating ELT pipelines and optimizing Spark resource configuration
  • Experience debugging Microsoft BI ETLs and converting them into Airflow-based big data pipelines
  • Ability to interact with business partners to gather requirements and provide technical solutions
  • Proficiency with Agile methodology and active team participation
  • Overlap with onsite team until 10-11 AM Pacific Time for ceremonies/interactions
  • Experience with cloud data platforms like Snowflake or Databricks
  • Knowledge of Financial domain, specifically Credit Card industry
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
5,017 Employees
Year Founded: 2007

What We Do

Photon.com has emerged as one of the world’s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit www.photon.com to learn more about us, how we work, and our customer case studies. Digital Transformation Starts Here.

Similar Jobs

Ericsson Logo Ericsson

Senior Software Architect

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
5 Locations
88000 Employees

Ericsson Logo Ericsson

Software Architect

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
5 Locations
88000 Employees

Ericsson Logo Ericsson

Technology Manager

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
5 Locations
88000 Employees

TransUnion Logo TransUnion

.NET Developer

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
2 Locations
13000 Employees

Similar Companies Hiring

Scrunch  Thumbnail
Artificial Intelligence • Information Technology • Marketing Tech • Software • SEO
Salt Lake City, Utah
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account