CloudThat

Data Engineering Lead

Posted 2 Days Ago

Be an Early Applicant

Mumbai, Maharashtra, IND

In-Office

Senior level

Cloud

The Role

Lead a team of three data engineers supporting a large-scale analytics platform. Manage and optimize ETL pipelines, data transformations, monitoring, reliability, production incidents, and SLA-driven enhancements. Collaborate with business advisory teams and maintain operational runbooks and documentation. Participate in a 24x7 P1 incident rotation, including weekend and night on-call coverage, and work from the Mumbai client site as required.

Summary Generated by Built In

About the Role:

We are looking for a Data Engineering Lead to join our AMS team supporting a large scale analytics platform for a major Oil & Gas enterprise. You will lead the data engineering track, managing ETL pipelines, data transformations, and ensuring platform reliability.

Key Technologies:

• AWS Glue, AWS Lambda, Amazon Redshift, Aurora PostgreSQL

• MSK Kafka, AWS SQS, AWS Transfer Family

• Apache Airflow (orchestration)

• SQL, Python

What You'll Do:

• Lead a team of 3 data engineers in maintaining & enhancing large-scale data assets

• Own ETL pipeline performance, monitoring & optimization

• Handle production incidents (24x7 rotation for P1 issues)

• Drive enhancements within defined SLA timelines

• Collaborate with client business advisory team

• Create & maintain runbooks and documentation

Requirements:

• 8+ years in Data Engineering with leadership experience

• Expert in AWS data services (Glue, Redshift, Aurora)

• Strong SQL and Python skills

• Experience managing production data pipelines at scale

• Ability to work from Mumbai (client site as required)

• Available for weekend/night on-call rotation

Nice to Have: - Experience in Oil & Gas domain / large enterprise analytics

Skills Required

8+ years of experience in data engineering
Leadership experience
Expertise in AWS data services, including Glue, Redshift, and Aurora
Strong SQL skills
Strong Python skills
Experience managing production data pipelines at scale
Ability to work from Mumbai at the client site as required
Availability for weekend and night on-call rotation
Experience in the Oil & Gas domain or large enterprise analytics

View all jobs at CloudThat

View CloudThat Profile

Report Job

Am I A Good Fit?

beta

Get Personalized Job Insights.

Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

HQ: Tampa, FL

375 Employees

Year Founded: 2012

What We Do

CloudThat is the first company in India to offer Cloud Training & Cloud Consultancy services for mid-market & enterprise clients from across the globe. Founded by Bhavesh Goswami, an ex-Amazonian with more than 17 years of experience in the Cloud Computing space, CloudThat has been empowering tech professionals with the best cloud training and cloud consulting services. Our journey in the Cloud space has won us many accolades, such as the prestigious Finalist of Microsoft Learning Partner of the Year Awards 2022 and 2020. CloudThat is also a proud AWS Advanced Consulting Partner, VMware Authorized Training Reseller, Google Cloud Platform Partner, Microsoft Gold Partner and Databricks Partner. Since our inception in 2012, we have trained over 500K IT professionals from fortune 500 companies in different types of cloud computing technologies such as Microsoft Azure, Amazon Web Services, Artificial Intelligence, Machine Learning, Google Cloud Platform, IoT, OpenStack, and OpenShift, DevOps, MongoDB, Big Data and more. We have also delivered over 200 AWS consulting services to top companies in need of cloud solutions. We have a global presence with offices in Bengaluru (India), the UK, and the USA. Our on-site and pre-scheduled public batches are available in different IT-centric cities in India and Overseas.