Lead Assistant Manager-Data Engineering-Cloud Data Engineering

Posted One Month Ago
Be an Early Applicant
Chennai, Tamil Nadu, IND
Hybrid
Senior level
Information Technology • Database • Consulting
The Role
Design, develop, and optimize data pipelines using PySpark and SQL; manage Snowflake data warehouses; process large-scale data through the Hadoop ecosystem; and ensure data quality, governance, performance, and reliability. The role also automates workflows, uses ETL and orchestration tools, and collaborates with data scientists, analysts, and business stakeholders.
Summary Generated by Built In
  1. The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driven decision-making across the organization.
Responsibilities
  1. Design, develop, and optimize robust data pipelines using PySpark and SQL.
  2. Implement and manage data warehousing solutions using Snowflake.
  3. Work with large-scale data processing frameworks within the Hadoop ecosystem.
  4. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
  5. Ensure data quality, integrity, and governance across all data platforms.
  6. Monitor and troubleshoot data pipeline performance and reliability.
  7. Automate data workflows and implement best practices for data engineering.
Qualifications
  1. 5+ years of experience in data engineering or related roles.
  2. Strong hands-on experience with Snowflake including data modeling, performance tuning, and security.
  3. Knowledge in PySpark for distributed data processing.
  4. Solid understanding of Hadoop ecosystem (HDFS, Hive, Spark, etc.).
  5. Advanced SQL skills for data manipulation and analysis.
  6. Experience with ETL tools and orchestration frameworks (e.g., Airflow, DBT).
  7. Familiarity with cloud platforms (AWS, Azure, or GCP) is a plus.
  8. Excellent problem-solving and communication skills.

Skills Required

  • 5+ years of experience in data engineering or related roles
  • Strong hands-on Snowflake experience, including data modeling, performance tuning, and security
  • Knowledge of PySpark for distributed data processing
  • Solid understanding of the Hadoop ecosystem, including HDFS, Hive, and Spark
  • Advanced SQL skills for data manipulation and analysis
  • Experience with ETL tools and orchestration frameworks such as Airflow or dbt
  • Familiarity with AWS, Azure, or GCP
  • Excellent problem-solving and communication skills

EXL Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about EXL and has not been reviewed or approved by EXL.

  • Healthcare Strength — Medical plan options include HSA, HRA, and PPO choices, with additional health-related programs such as disability coverage and an employee assistance program. Feedback suggests these options provide meaningful flexibility and coverage breadth for many roles.
  • Leave & Time Off Breadth — Up to 20 days of paid time off, plus federal holidays and paid sick and safe time, are highlighted. Feedback suggests this leave structure is a notable benefit alongside core compensation.
  • Retirement Support — A traditional and Roth 401(k) with up to a 3% company match and full vesting after one year is described. Feedback suggests this match and vesting timeline help bolster long-term savings.

EXL Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
30,246 Employees
Year Founded: 1999

What We Do

Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.

Similar Jobs

CSC Logo CSC

Operations Specialist

Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Remote or Hybrid
2 Locations
8500 Employees

CSC Logo CSC

Administrative Assistant

Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Remote or Hybrid
2 Locations
8500 Employees

Sectigo Logo Sectigo

Validation Specialist I

Information Technology • Internet of Things • Machine Learning • Software
In-Office
Chennai, Tamil Nadu, IND
600 Employees
400K-450K Annually

TransUnion Logo TransUnion

Technical Product Manager

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
2 Locations
13000 Employees

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account