About Us
“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.
WHY JOIN CAPCO?
You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.
MAKE AN IMPACT
Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.
#BEYOURSELFATWORK
Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.
CAREER ADVANCEMENT
With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.
DIVERSITY & INCLUSION
We believe that diversity of people and perspective gives us a competitive advantage.
MAKE AN IMPACT
WHY JOIN CAPCO?
You will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry. We offer: • A work culture focused on innovation and creating lasting value for our clients and employees • Ongoing learning opportunities to help you acquire new skills or deepen existing expertise • A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients • A diverse, inclusive, meritocratic culture
We offer:
- A work culture focused on innovation and creating lasting value for our clients and employees
- Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
- A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients
Python Developer – PySpark | 5–7 Years | Chennai
Position Purpose:
- Overall, 5-7 years of experience as a Python Developer with Spark.
- The Python / PySpark Developer will design, develop, test, and maintain high‑performance data‑processing pipelines using strong Python, pyspark and SQL skills.
- You will transform raw market, trade, and client data into trusted, consumable data‑sets that feed downstream analytics, reporting, and machine‑learning models used by the CEFS – Client Engagement and Financial Securities franchise.
- Sound knowledge of Agile (Scrum/Kanban).
Responsibilities
Direct Responsibilities
- Design & develop robust ingestion, transformation, and enrichment pipelines with Python, PySpark, and SQL.
- Write and optimize complex SQL queries, analytical UDFs, and window functions for data aggregation and reporting.
- Collaborate with CEFS data architects, data scientists, and business analysts to translate functional requirements into technical specifications.
- Unit‑test, integrate‑test, and review code.
- Maintain CI/CD pipelines (Git, Jenkins, Docker) for automated build, test, and deployment of jobs.
- Monitor production workloads and troubleshoot performance bottlenecks, memory issues, and job failures.
- Document data lineage, pipeline design, and operational run‑books in Confluence/SharePoint.
- Keep up to date with latest technologies and trends and provide input, expertise and recommendations.
Contributing Responsibilities
- Contribute towards innovation (e.g. AI/ML); suggest new technical practices for efficiency improvement.
- Participate in Agile ceremonies (sprint planning, daily standups, retrospectives) and help groom the backlogs.
- Mentor junior engineers and champion best practices in Python coding, Spark optimization, and data‑engineering patterns.
- Evaluate emerging technologies and deliver proof‑of‑concepts for CEFS.
Technical & Behavioral Competencies
- Resourceful to quickly understand complexities involved and provide the way forward.
- Good experience in technical analysis of n-tier applications with multiple integrations using object oriented, APIs & Microservices approaches.
- Strong knowledge about design patterns and development principles.
- Inclination and prior experience of working across SQL, Python and ETL.
- Strong Hands-on experience - Python (NumPy, pandas, Python Frameworks, Restful APIs, MS-SQL or Oracle.
- PySpark - DataFrames, Spark SQL, Structured Streaming, performance tuning (partitioning, caching, broadcast joins).
- Advanced SQL – complex queries, stored procedures, query optimization.
- Good Knowledge and experience to use Python packages such as Pandas, NumPy, etc. for cleaning up of Data, Data Wrangling, Analysis of Data and Visualization of Data.
- Good experience in development and maintenance of code/scripts in both functional and technical specifications of all applications component, bug fixing and production support.
- Good knowledge on Linux/Unix environment (basic commands, shell scripting, etc.), testing phases, documentation and new framework.
- Some experience of working with build tools like Maven & DevOps tools like Bitbucket, Jenkins.
- Knowledge of Agile, Scrum, DevOps.
- Development experience in Data Engineering environment.
- Ability & willingness to learn & work on diverse technologies (languages, frameworks, and tools).
- Self-motivated, good interpersonal skills and inclination to constantly upgrade new technologies and frameworks.
- Good communication and co-ordination skills.
Specific Qualifications:
- Good to have knowledge of front-end technologies preferably Flask.
Skills Referential (Required knowledge, skills and abilities)
Technical Skills:
- Python
- Pyspark
- SQL
- ETL
Behavioral Skills:
- Ability to synthetize / simplify
- Ability to collaborate / Teamwork
- Attention to detail / rigor
- Ability to deliver / Results driven
Education Level: Bachelor’s degree or equivalent
Location: Chennai
Skills Required
- 5-7 years of experience as a Python Developer with Spark
- Strong hands-on experience with Python, including NumPy, pandas, Python frameworks, RESTful APIs, and MS SQL or Oracle
- Strong hands-on experience with PySpark, including DataFrames, Spark SQL, Structured Streaming, and performance tuning
- Advanced SQL skills, including complex queries, stored procedures, and query optimization
- Experience with ETL and data engineering environments
- Knowledge of Linux or Unix environments and shell scripting
- Experience with testing, documentation, bug fixing, and production support
- Experience with build and DevOps tools such as Maven, Bitbucket, and Jenkins
- Knowledge of Agile, Scrum, and DevOps
- Bachelor's degree or equivalent
- Knowledge of front-end technologies, preferably Flask
What the Team is Saying
Capco Compensation & Benefits Highlights
-
Healthcare Strength — Health, dental, and vision coverage in the U.S. are characterized as strong, with good coverage and favorable costs. Mental health resources and broader wellbeing programs are also emphasized as part of a comprehensive package.
-
Leave & Time Off Breadth — PTO and paid holidays are described as generous, with multiple mentions of strong vacation allowances. While client work can affect usage, the underlying entitlement is presented as solid.
-
Parental & Family Support — Company materials highlight enhanced family-friendly policies, including substantial maternity and paternity leave. Flexibility and return-to-work support reinforce a family-oriented approach.
Capco Insights
What We Do
Capco, a Wipro company, is a global management and technology consultancy specializing in driving transformation in the energy and financial services industries. Capco operates at the intersection of business and technology by combining innovative thinking with unrivalled industry knowledge to fast-track digital initiatives for banking and payments, capital markets, wealth and asset management, insurance, and the energy sector. Capco’s cutting edge ingenuity is brought to life through its award-winning Be Yourself At Work culture and diverse talent. TRUSTED ADVISORS - Our collaborative and entrepreneurial approach position us as trusted long-term partners to our clients. DEEP EXPERTISE - Clients look to us for clear guidance, proven expertise, and the support they need to set their companies up for success. DISRUPTIVE SOLUTIONS- We do not provide off -the-shelf answers to clients’ challenges. Instead, we work in close collaboration to understand the issues, and craft disruptive, bespoke solutions. ACCOUNTABILITY AND OWNERSHIP - We recognize every client has distinct needs and expectations, and we take ownership and accountability for the solutions we design, build, and deliver.
Why Work With Us
We support and encourage an inclusive culture, entrepreneurial outlook and independent thinking. Capco is not about organizational charts and rigid hierarchies – we want all employees to feel that Capco is their firm to own and run. We believe diversity powers innovation. Be Yourself At Work (#BYAW) is an integral and underlying part of our culture
Gallery
Capco Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
