Big Data and Apache Spark Developer - Assistant Vice President

Posted 4 Days Ago
Be an Early Applicant
Pune, Mahārāshtra, IND
In-Office
Senior level
Fintech • Financial Services
The Role
Develop and maintain large-scale Apache Spark data processing applications and scalable ETL pipelines using Java or Python. Work with SQL, relational databases, distributed computing, and big data technologies while troubleshooting production issues and optimizing performance. Collaborate with analysts, QA teams, and stakeholders, participate in code reviews, and support modernization, migration, and automation initiatives. Apply AI-assisted development tools with strong engineering judgment to deliver secure, maintainable, production-ready solutions.
Summary Generated by Built In

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.


Key Responsibilities:

  • Design, develop, test, and maintain data processing applications using Apache Spark.
  • Build scalable ETL and data transformation pipelines for large datasets.
  • Develop and support applications using Java or Python in a distributed data environment.
  • Analyze requirements and collaborate with business analysts, QA teams, and stakeholders to deliver solutions.
  • Troubleshoot production issues and optimize application performance.
  • Participate in code reviews and follow engineering best practices.
  • Contribute to application modernization, migration, and automation initiatives.
  • Leverage AI-assisted development tools to improve productivity and quality.

Required Skills:

  • 8-10 years of software development experience.
  • Strong hands-on experience with Apache Spark.
  • Proficiency in either Java or Python.
  • Candidates with primary expertise in Python should have a good understanding of Java fundamentals (OOP concepts, collections, exception handling, multithreading basics).
  • Experience working with SQL and relational databases.
  • Understanding of distributed computing concepts and big data processing.
  • Strong analytical, problem-solving, and debugging skills.

Preferred Skills:

  • Experience with Databricks (highly desirable).
  • Exposure to cloud platforms and modern data engineering practices.
  • Experience with CI/CD pipelines, Git, and Agile development methodologies.
  • Knowledge of regulatory reporting or financial services domain is a plus.
AI Mindset & Engineering Excellence
  • Demonstrated ability and willingness to adopt AI-assisted development tools (e.g., GitHub Copilot, Devin, Databricks Assistant, or similar) to improve productivity, code quality, and delivery efficiency.
  • Ability to effectively leverage AI-generated recommendations for coding, testing, debugging, documentation, and analysis while maintaining accountability for final deliverables.
  • Strong engineering judgment to critically review, validate, and optimize AI-generated code and solutions rather than relying solely on tool outputs.
  • Capable of identifying potential functional, performance, security, and maintainability issues in AI-assisted implementations and making appropriate corrections.
  • Passion for continuous learning and staying current with emerging AI technologies and software engineering best practices.

Nice to Have:

  • Experience with Spark performance tuning.
  • Familiarity with data lake architectures.
  • Experience leveraging AI tools such as Copilot or similar developer productivity solutions.

This role offers an opportunity to work on large-scale data platforms, modernization initiatives, and business-critical applications while collaborating with global team

We are seeking an Intermediate Big Data Spark Developer to design, develop, enhance, and support large-scale data processing solutions.


The ideal candidate is a strong Spark developer with proficiency in Java or Python, a solid understanding of distributed data processing, and a growth mindset toward adopting modern AI-powered development practices. They should be able to combine the productivity gains offered by AI tools with sound technical judgment, ensuring solutions are accurate, scalable, maintainable, and production-ready.


Key Responsibilities:

  • Design, develop, test, and maintain data processing applications using Apache Spark.
  • Build scalable ETL and data transformation pipelines for large datasets.
  • Develop and support applications using Java or Python in a distributed data environment.
  • Analyze requirements and collaborate with business analysts, QA teams, and stakeholders to deliver solutions.
  • Troubleshoot production issues and optimize application performance.
  • Participate in code reviews and follow engineering best practices.
  • Contribute to application modernization, migration, and automation initiatives.
  • Leverage AI-assisted development tools to improve productivity and quality.

Required Skills:

  • 8-10 years of software development experience.
  • Strong hands-on experience with Apache Spark.
  • Proficiency in either Java or Python.
  • Candidates with primary expertise in Python should have a good understanding of Java fundamentals (OOP concepts, collections, exception handling, multithreading basics).
  • Experience working with SQL and relational databases.
  • Understanding of distributed computing concepts and big data processing.
  • Strong analytical, problem-solving, and debugging skills.

Preferred Skills:

  • Experience with Databricks (highly desirable).
  • Exposure to cloud platforms and modern data engineering practices.
  • Experience with CI/CD pipelines, Git, and Agile development methodologies.
  • Knowledge of regulatory reporting or financial services domain is a plus.
AI Mindset & Engineering Excellence
  • Demonstrated ability and willingness to adopt AI-assisted development tools (e.g., GitHub Copilot, Devin, Databricks Assistant, or similar) to improve productivity, code quality, and delivery efficiency.
  • Ability to effectively leverage AI-generated recommendations for coding, testing, debugging, documentation, and analysis while maintaining accountability for final deliverables.
  • Strong engineering judgment to critically review, validate, and optimize AI-generated code and solutions rather than relying solely on tool outputs.
  • Capable of identifying potential functional, performance, security, and maintainability issues in AI-assisted implementations and making appropriate corrections.
  • Passion for continuous learning and staying current with emerging AI technologies and software engineering best practices.

Nice to Have:

  • Experience with Spark performance tuning.
  • Familiarity with data lake architectures.
  • Experience leveraging AI tools such as Copilot or similar developer productivity solutions.

This role offers an opportunity to work on large-scale data platforms, modernization initiatives, and business-critical applications while collaborating with global team

------------------------------------------------------

Job Family Group: Technology

------------------------------------------------------

Job Family:Applications Development

------------------------------------------------------

Time Type:Full time

------------------------------------------------------

Most Relevant Skills Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills Required

  • 8-10 years of software development experience
  • Strong hands-on experience with Apache Spark
  • Proficiency in Java or Python
  • Python-focused candidates must understand Java fundamentals, including object-oriented programming, collections, exception handling, and multithreading basics
  • Experience with SQL and relational databases
  • Understanding of distributed computing concepts and big data processing
  • Strong analytical, problem-solving, and debugging skills
  • Experience with Databricks
  • Exposure to cloud platforms and modern data engineering practices
  • Experience with CI/CD pipelines, Git, and Agile development methodologies
  • Knowledge of regulatory reporting or financial services
  • Experience with Spark performance tuning
  • Familiarity with data lake architectures
  • Experience using AI-assisted development tools such as GitHub Copilot or similar solutions

Citi Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Citi and has not been reviewed or approved by Citi.

  • Healthcare Strength — Health coverage is presented as comprehensive, including free in-network preventive care, mental-health resources, and the Be Well Program. Materials also state new hires have access to health and insurance benefits from the outset.
  • Retirement Support — The retirement plan offers a $1-for-$1 match up to 6% of eligible pay. New employees are eligible for the plan, with automatic enrollment after 90 days if they do not enroll themselves.
  • Inclusive Benefits Coverage — Benefits highlight fertility treatment coverage, adoption/surrogacy reimbursement up to $30,000, and disability coverage. Coverage extends to spouses and domestic partners regardless of gender identity or sexuality, with gender-affirming care-related support noted.

Citi Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kwun Tong, Kowloon
223,850 Employees

What We Do

Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. We are Citi, the global bank – an institution connecting millions of people across hundreds of countries and cities.

Similar Jobs

Citi Logo Citi

Big Data Engineer

Fintech • Financial Services
In-Office
Pune, Mahārāshtra, IND
223850 Employees

Cin7 Logo Cin7

Global Director of People and Culture

Cloud • eCommerce • Logistics • Software
Easy Apply
In-Office or Remote
Pune, Mahārāshtra, IND
276 Employees
Hybrid
Pune, Mahārāshtra, IND
289097 Employees

Built In Logo Built In

Staff Software Engineer

Consumer Web • HR Tech
Easy Apply
Remote or Hybrid
India
100 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account