Lead Assistant Manager-Data Engineering-Cloud Data Engineering

Posted Yesterday
Be an Early Applicant
Chennai, Tamil Nadu, IND
Hybrid
Senior level
Information Technology • Database • Consulting
The Role
Design, develop, and optimize data pipelines using PySpark and SQL; manage Snowflake data warehouses; process large-scale data through the Hadoop ecosystem; and ensure data quality, governance, performance, and reliability. The role also automates workflows, uses ETL and orchestration tools, and collaborates with data scientists, analysts, and business stakeholders.
Summary Generated by Built In
  1. The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driven decision-making across the organization.
Responsibilities
  1. Design, develop, and optimize robust data pipelines using PySpark and SQL.
  2. Implement and manage data warehousing solutions using Snowflake.
  3. Work with large-scale data processing frameworks within the Hadoop ecosystem.
  4. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
  5. Ensure data quality, integrity, and governance across all data platforms.
  6. Monitor and troubleshoot data pipeline performance and reliability.
  7. Automate data workflows and implement best practices for data engineering.
Qualifications
  1. 5+ years of experience in data engineering or related roles.
  2. Strong hands-on experience with Snowflake including data modeling, performance tuning, and security.
  3. Knowledge in PySpark for distributed data processing.
  4. Solid understanding of Hadoop ecosystem (HDFS, Hive, Spark, etc.).
  5. Advanced SQL skills for data manipulation and analysis.
  6. Experience with ETL tools and orchestration frameworks (e.g., Airflow, DBT).
  7. Familiarity with cloud platforms (AWS, Azure, or GCP) is a plus.
  8. Excellent problem-solving and communication skills.

Skills Required

  • 5+ years of experience in data engineering or related roles
  • Strong hands-on Snowflake experience, including data modeling, performance tuning, and security
  • Knowledge of PySpark for distributed data processing
  • Solid understanding of the Hadoop ecosystem, including HDFS, Hive, and Spark
  • Advanced SQL skills for data manipulation and analysis
  • Experience with ETL tools and orchestration frameworks such as Airflow or dbt
  • Familiarity with AWS, Azure, or GCP
  • Excellent problem-solving and communication skills
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
30,246 Employees
Year Founded: 1999

What We Do

Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.

Similar Jobs

TransUnion Logo TransUnion

Senior Python Engineer

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Chennai, Tamil Nadu, IND
13000 Employees

Toast Logo Toast

Payroll Specialist

Cloud • Fintech • Food • Information Technology • Software • Hospitality
In-Office
Chennai, Tamil Nadu, IND
5000 Employees

Toast Logo Toast

Payroll Specialist

Cloud • Fintech • Food • Information Technology • Software • Hospitality
In-Office
Chennai, Tamil Nadu, IND
5000 Employees

Coursera + Udemy  Logo Coursera + Udemy

LLMops Engineer

Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Remote or Hybrid
India
1500 Employees

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account