Job Title: Data Engineer (PySpark / Databricks)
Experience: 5–9 Years Location: Pune (Hybrid – Capco Office)
Job Summary
We are looking for a skilled Data Engineer with strong expertise in PySpark, Databricks, and modern data engineering practices. The ideal candidate will have hands-on experience in building scalable data pipelines, working with large datasets, and leveraging cloud-based data platforms.
Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines Work extensively with PySpark and Apache Spark for large-scale data processing Build and manage workflows using Apache Airflow Develop and optimize data solutions on Databricks (Jobs, Delta Lake) Work with cloud-based data lakes (S3 or equivalent) Write efficient and complex SQL queries for data transformation and analysis Run and manage Spark workloads on EMR Serverless or other managed Spark platforms Ensure data quality, reliability, and performance optimization of pipelines Must Have Skills Strong hands-on experience with PySpark and Apache Spark internals Experience with Databricks (Jobs, Delta Lake) Proficiency in Apache Airflow for workflow orchestration Solid experience building ETL/ELT pipelines at scale Strong SQL skills and experience with Data Warehouse (DWH) systems Experience running Spark workloads on EMR Serverless or managed Spark platforms Hands-on experience with cloud data lakes (S3 or equivalent) Good to Have Skills Experience with Delta Lake / Apache Iceberg Exposure to streaming frameworks (Spark Structured Streaming, Kafka) Familiarity with CI/CD pipelines for data engineering workflows Knowledge of data governance, cataloging, and lineage tools
Skills Required
- Strong hands-on experience with PySpark and Apache Spark internals
- Experience with Databricks (Jobs, Delta Lake)
- Proficiency in Apache Airflow for workflow orchestration
- Solid experience building ETL/ELT pipelines at scale
- Strong SQL skills and experience with Data Warehouse (DWH) systems
- Experience running Spark workloads on EMR Serverless or managed Spark platforms
- Hands-on experience with cloud data lakes (S3 or equivalent)
What the Team is Saying
Capco Compensation & Benefits Highlights
-
Healthcare Strength — Health, dental, vision, EAP and fitness support are described as solid, reinforced by a global wellbeing program with mental‑health resources and financial‑wellness content.
-
Leave & Time Off Breadth — Vacation & Paid Time Off and Sick Leave are characterized as strong, with flexible, hybrid working and family‑friendly policies also highlighted.
-
Parental & Family Support — Parental leave is presented as a strong point alongside adoption, fertility and childcare benefits, with exact terms varying by country and role.
Capco Insights
What We Do
Capco, a Wipro company, is a global management and technology consultancy specializing in driving transformation in the energy and financial services industries. Capco operates at the intersection of business and technology by combining innovative thinking with unrivalled industry knowledge to fast-track digital initiatives for banking and payments, capital markets, wealth and asset management, insurance, and the energy sector. Capco’s cutting edge ingenuity is brought to life through its award-winning Be Yourself At Work culture and diverse talent. TRUSTED ADVISORS - Our collaborative and entrepreneurial approach position us as trusted long-term partners to our clients. DEEP EXPERTISE - Clients look to us for clear guidance, proven expertise, and the support they need to set their companies up for success. DISRUPTIVE SOLUTIONS- We do not provide off -the-shelf answers to clients’ challenges. Instead, we work in close collaboration to understand the issues, and craft disruptive, bespoke solutions. ACCOUNTABILITY AND OWNERSHIP - We recognize every client has distinct needs and expectations, and we take ownership and accountability for the solutions we design, build, and deliver.
Why Work With Us
We support and encourage an inclusive culture, entrepreneurial outlook and independent thinking. Capco is not about organizational charts and rigid hierarchies – we want all employees to feel that Capco is their firm to own and run. We believe diversity powers innovation. Be Yourself At Work (#BYAW) is an integral and underlying part of our culture
Gallery
Capco Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
