Senior Cloud Administrator (AWS Data Engineer)

Posted Yesterday
Be an Early Applicant
Pune, Maharashtra, IND
Hybrid
Senior level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Where passion changes lives
The Role
Designs, develops, supports, and optimizes scalable data pipelines and distributed processing workloads. Writes production-grade Python, PySpark, and SQL; tunes Spark and SQL performance; troubleshoots Linux and AWS infrastructure; improves monitoring, reliability, security, and cost efficiency; performs root cause analysis; and collaborates with engineering, product, architecture, and operations teams. The role also supports AI-enabled data workflows using LLMs, Amazon Bedrock, Agentic AI, and MCP.
Summary Generated by Built In
ZS is a place where passion changes lives. As a management consulting and technology firm focused on improving life and how we live it, we transform ideas into impact by bringing together data, science, technology and human ingenuity to deliver better outcomes for all. Here you'll work side-by-side with a powerful collective of thinkers and experts shaping life-changing solutions for patients, caregivers and consumers, worldwide. ZSers drive impact by bringing a client-first mentality to each and every engagement. We partner collaboratively with our clients to develop custom solutions and technology products that create value and deliver company results across critical areas of their business. Bring your curiosity for learning, bold ideas, courage and passion to drive life-changing impact to ZS.
What You'll Do : As a Senior Cloud Administrator at ZS you will combine strong data engineering skills with practical cloud infrastructure knowledge. The role is primarily responsible for designing, developing, supporting, and optimizing scalable data pipelines and distributed data-processing workloads. The successful candidate will work across Spark, Hadoop, SQL, Python and Linux, while supporting analytics services and the underlying AWS environment required to run them reliably, securely and cost-effectively. This is a hands-on role for a data engineer who can own complex transformations, tune jobs, troubleshoot production issues, automate recurring operational work, and collaborate with product, engineering, operations and architecture teams. The role also contributes to emerging AI-enabled data workflows through an understanding of Large Language Models, Amazon Bedrock, Agentic AI and Model Context Protocol (MCP).
  • Design, develop, maintain and support robust data pipelines that ingest, transform and deliver data for analytics, reporting, machine learning and AI use cases.
  • Write and review production-grade Python, PySpark and SQL for complex, high-volume data transformations.
  • Optimize Spark and SQL workloads for performance, scalability and cost by analyzing execution plans, partitioning, skew, caching, memory pressure and I/O patterns.
  • Build reusable ingestion and transformation components, common utilities and automation frameworks that reduce manual intervention and improve delivery consistency.
  • Monitor scheduled pipelines and distributed jobs, investigate failures, restore services, and improve observability, alerting, and operational runbooks.
  • Perform hands-on troubleshooting across the data-processing layer and supporting cloud infrastructure, including Linux hosts, storage, access, networking and service configuration.
  • Conduct root cause analysis for recurring or high-impact incidents and implement long-term remediation to prevent recurrence.
  • Apply data-engineering standards for reliability, maintainability, data quality, security and governance throughout the development lifecycle.
  • Partner with data producers, consumers, architects, product teams and cloud operations teams to translate requirements into practical technical solutions.
  • Contribute to technical design reviews, code reviews, release validation, capacity planning and productionreadiness assessments.
  • Support proofs of concept involving LLMs, Amazon Bedrock, Agentic AI and MCP-based integrations where they intersect with enterprise data platforms.
  • Work with AWS or other technology vendors and subject matter experts for advanced troubleshooting when required.

What You'll Bring:
  • 4+ years of hands-on experience in data engineering, including Apache Spark, Hadoop ecosystems and Data Warehousing.
  • Strong expertise in designing, building, testing, and supporting scalable batch or ETL/ELT data pipelines.
  • Hands-on expertise in Spark or PySpark development, including distributed processing concepts and job optimization.
  • Advanced SQL skills, including complex joins, window functions, aggregations, query tuning and data validation.
  • Strong Python skills for data processing, reusable frameworks, automation and operational tooling.
  • In-depth hands-on experience with Linux, shell utilities, logs, processes, file systems and troubleshooting.
  • Proven ability to implement complex data transformations, including cleansing, deduplication, enrichment, aggregation and slowly changing dimension patterns.
  • Sound understanding of data warehousing, data lakes, partitioning, file formats, schema evolution and data quality controls.
  • Experience diagnosing and optimizing pipeline performance, including parallelism, partition sizing, data skew, memory usage, shuffle behavior and inefficient SQL patterns.
  • Ability to troubleshoot complex production issues, perform root cause analysis and implement sustainable corrective actions.
  • Understanding of cloud infrastructure fundamentals relevant to analytics workloads, including compute, storage, identity and access, networking, monitoring and cost management.
  • Understanding of Large Language Models, Amazon Bedrock, Agentic AI patterns and Model Context Protocol (MCP) concepts.
  • Ability to collaborate with cross-functional and globally distributed teams and communicate technical findings clearly to stakeholders.
  • Hands-on experience with AWS analytics services such as Amazon EMR, AWS Glue, Amazon Athena, Amazon SageMaker, etc.
  • Experience with Amazon S3-based data lakes and related security, cataloging, partitioning and performance
    considerations.
  • Exposure to workflow orchestration or scheduling tools and CI/CD practices for data pipelines.
  • Familiarity with infrastructure-as-code or cloud automation tools used to provision and manage analytics
    environments.
  • Knowledge of streaming data, open table formats, data governance, or metadata and catalog solutions.
  • Experience supporting secure, regulated or mission-critical analytics platforms.
  • Associate-level or higher AWS certification, or relevant data engineering certification
  • Fluency in English
  • Client-first mentality
  • Intense work ethic
  • Collaborative spirit and problem-solving approach

How you'll grow:
  • Cross-functional skills development & custom learning pathways
  • Milestone training programs aligned to career progression opportunities
  • Internal mobility paths that empower growth via s-curves, individual contribution and role expansions

Perks & Benefits:
At ZS, your growth matters. We offer a comprehensive total rewards package that supports your health and well-being, financial future, time away, and professional development. With robust skills-building programs, multiple career progression paths, internal mobility, and a deeply collaborative culture, you'll have the opportunity to do meaningful work, expand your capabilities, and thrive as part of a global community. For details on total rewards in India , visit ZS India office locations | Where we work | ZS .
Hybrid working model:
We are committed to giving our employees a flexible and connected way of working. A flexible and connected ZS allows us to combine work from home and on-site presence at clients/ZS offices for the majority of our week. The magic of ZS culture and innovation thrives in both planned and spontaneous face-to-face connections.
Travel:
Travel is a requirement at ZS for client facing ZSers; business needs of your project and client are the priority. While some projects may be local, all client-facing ZSers should be prepared to travel as needed. Travel provides opportunities to strengthen client relationships, gain diverse experiences, and enhance professional growth by working in different environments and cultures.
Considering applying?
At ZS, we honor the visible and invisible elements of our identities, personal experiences, and belief systems-the ones that comprise us as individuals, shape who we are, and make us unique. We believe your personal interests, identities, and desire to learn are integral to your success here. We are committed to building a team that reflects a broad variety of backgrounds, perspectives, and experiences. Learn more about our inclusion and belonging efforts and the networks ZS supports to assist our ZSers in cultivating community spaces and obtaining the resources they need to thrive.
If you're eager to grow, contribute, and bring your unique self to our work, we encourage you to apply.
ZS is an equal opportunity employer and is committed to providing equal employment and advancement opportunities without regard to any class protected by applicable law.
To complete your application:
Candidates must possess or be able to obtain work authorization for their intended country of employment. An on-line application, including a full set of transcripts (official or unofficial), is required to be considered.
NO AGENCY CALLS, PLEASE.
Find Out More At:
www.zs.com

Skills Required

  • 4+ years of hands-on data engineering experience, including Apache Spark, Hadoop ecosystems, and data warehousing
  • Experience designing, building, testing, and supporting scalable batch or ETL/ELT data pipelines
  • Hands-on Spark or PySpark development experience, including distributed processing and job optimization
  • Advanced SQL skills, including complex joins, window functions, aggregations, query tuning, and data validation
  • Strong Python skills for data processing, reusable frameworks, automation, and operational tooling
  • In-depth Linux experience, including shell utilities, logs, processes, file systems, and troubleshooting
  • Experience implementing complex data transformations, including cleansing, deduplication, enrichment, aggregation, and slowly changing dimensions
  • Understanding of data warehousing, data lakes, partitioning, file formats, schema evolution, and data quality controls
  • Experience diagnosing and optimizing pipeline performance, including parallelism, partition sizing, data skew, memory usage, shuffle behavior, and SQL efficiency
  • Ability to troubleshoot complex production issues, perform root cause analysis, and implement corrective actions
  • Understanding of cloud infrastructure fundamentals, including compute, storage, identity and access, networking, monitoring, and cost management
  • Understanding of Large Language Models, Amazon Bedrock, Agentic AI patterns, and Model Context Protocol concepts
  • Ability to collaborate with cross-functional and globally distributed teams and communicate technical findings clearly
  • Hands-on experience with AWS analytics services such as Amazon EMR, AWS Glue, Amazon Athena, or Amazon SageMaker
  • Experience with Amazon S3-based data lakes, including security, cataloging, partitioning, and performance considerations
  • Exposure to workflow orchestration or scheduling tools and CI/CD practices for data pipelines
  • Familiarity with infrastructure-as-code or cloud automation tools
  • Knowledge of streaming data, open table formats, data governance, metadata, or catalog solutions
  • Experience supporting secure, regulated, or mission-critical analytics platforms
  • Associate-level or higher AWS certification or relevant data engineering certification
  • Fluency in English

What the Team is Saying

Ash Easwar
Suzanne Boyan
Kristina Sambucci
Callum Brazier
Michelle Lu
Mike Vula
Mina Labib
Judith Kulich
Anna Simon
Rachana Late
Bazgha Qutab
Ayush Kataria
Carolina Blanco
Kumar Ritwik
Emily Reynolds
Mahmood Majeed
Mahmood Majeed
Bazgha Qutab
Mahmood Majeed
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Evanston, IL
15,000 Employees
Year Founded: 1983

What We Do

ZS is a management consulting and technology firm that partners with companies to improve life and how we live it. We transform ideas into impact by bringing together data, science, technology and human ingenuity to deliver better outcomes for all. Founded in 1983, ZS has more than 15,000+ employees in over 40 offices worldwide.

Why Work With Us

ZS is home to passionate people who embrace innovative thinking, collaboration and a client-first mindset. Welcome to a company where new ideas are celebrated, curiosity is welcomed, learning opportunities are abundant and colleagues become lifelong connections.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

ZS Teams

Team
Product & Tech
Team
Engineering
Team
Insights & Analytics
Team
Continuous Learning and Growth
About our Teams

ZS Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

The Flexible & Connected model is our ZS standard. ZSers decide where it makes the most sense for them to work each day given client or teamwork.

Typical time on-site: 3 days a week
Company Office Image
HQEvanston (Global HQ)
Company Office Image
JP
Company Office Image
Atlanta, GA
Company Office Image
Barcelona, ES
Company Office Image
Seattle
Company Office Image
Bengaluru, Karnataka
Company Office Image
Berlin, DE
Company Office Image
Washington D.C.
Company Office Image
Boston, MA
Company Office Image
Buenos Aires
Company Office Image
Cambridge, GB
Company Office Image
Chicago - Merchandise Mart
Company Office Image
Chicago—Prudential Plaza
Company Office Image
Raleigh-Durham
Company Office Image
San Francisco (Foster City)
Company Office Image
Frankfurt
Company Office Image
Gurugram
Company Office Image
Hyderabad (Global Capability Center)
Company Office Image
Copenhagen
Company Office Image
London, GB
Company Office Image
Milan, MI
Company Office Image
New York, NY
Company Office Image
Noida
Company Office Image
Paris, FR
Company Office Image
Philadelphia, PA
Company Office Image
Princeton
Company Office Image
Pune (International Tech Park)
Company Office Image
Pune (World Trade Center)
Company Office Image
San Diego, CA
Company Office Image
São Paulo, BR
Company Office Image
Singapore
Company Office Image
San Francisco (South)
Company Office Image
Los Angeles
Company Office Image
Tokyo, JP
Company Office Image
Toronto, Ontario
Company Office Image
Zürich, CH
Learn more

Similar Jobs

ZS Logo ZS

Decision Analytics Associate

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
5 Locations
15000 Employees

ZS Logo ZS

Business Technology Solutions Associate

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
5 Locations
15000 Employees

ZS Logo ZS

Senior Human Resources Associate - Mobility

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
Pune, Maharashtra, IND
15000 Employees

ZS Logo ZS

Finance Associate - Client Accounting

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
Pune, Maharashtra, IND
15000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account