Python and Apache Spark Big Data Engineer - Assistant Vice President

Posted 7 Days Ago
Be an Early Applicant
Pune, Mahārāshtra, IND
In-Office
Expert/Leader
Fintech • Financial Services
The Role
Develop and maintain scalable Python and Scala applications for big data platforms. Design high-performance Spark components, process large datasets using Hive, Impala, and HBase, tune application performance, troubleshoot issues, and implement testing and SDLC practices. Translate requirements into technical solutions, identify bottlenecks, establish development standards, collaborate with global teams, and transfer tested prototypes to operations.
Summary Generated by Built In

Experience Range - 8 to 12 years

Strong experience with one or more programming languages (Python/Spark).
•  Demonstrated analytical and problem-solving skills. Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain. 
•  Comfortable working with large data volumes and be able to demonstrate a firm understanding of logical data structures and analysis techniques. 
•  Experience in Big data technologies like HDFS, Map Reduce, YARN, Apache Spark, Hive. 
•  Familiarity with data formats like Avro, Parquet, CSV, JSON. 
•  Strong systems analysis, design and architecture fundamentals, Unit Testing and other SDLC activities. 
•  Understanding fundamental design principles behind a scalable application. 
•  Experience in working with UNIX/LINUX and shell scripting. 
•  Good knowledge of database principles, practices with SQL. 
•  Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain. Good to Have: 
•  Agile/Scrum methodology experience is required. 
•  Experience in SCMs like GIT and tools like JIRA. 
•  Experience in No SQL databases. 
•  Familiarity with build tools such as Maven and continuous integration like Jenkins/Team City. 
•  Familiarity with cloud and container technologies. 
•  Experience real time data processing - Kafka. 
Responsibilities: 
•  Translate application storyboards and use cases into functional applications. 
•  Design, build, and maintain efficient, reusable, and reliable Python/Scala code. 
•  Ensure the best possible performance, quality, and responsiveness of the applications. 
•  Identify bottlenecks and bugs, and devise solutions to these problems. 
•  Develop high performance & low latency components to run Spark clusters. 
•  Interpreting functional requirements into design approaches those can be served through Big Data platform. 
•  Collaborate and partner with Global Teams based across different locations. 
•  Be able to propose best practices and standards. 
•  Perform the testing of software prototypes and transfer to the operational team. 
•  Processing of data using Hive, Impala & HBASE. 
•  Performing analysis of large data sets and derive insights.

------------------------------------------------------

Job Family Group: Technology

------------------------------------------------------

Job Family:Applications Development

------------------------------------------------------

Time Type:Full time

------------------------------------------------------

Most Relevant Skills Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills Required

  • 8 to 12 years of experience
  • Strong experience with Python or Apache Spark
  • Analytical and problem-solving skills
  • Application performance tuning and troubleshooting experience in big data
  • Experience working with large data volumes and logical data structures
  • Experience with HDFS, MapReduce, YARN, Apache Spark, and Hive
  • Familiarity with Avro, Parquet, CSV, and JSON data formats
  • Systems analysis, design, architecture, unit testing, and SDLC experience
  • Understanding of scalable application design principles
  • Experience with Unix/Linux and shell scripting
  • Knowledge of database principles and SQL
  • Agile/Scrum methodology experience
  • Experience with Git and JIRA
  • Experience with NoSQL databases
  • Familiarity with Maven and Jenkins or TeamCity
  • Familiarity with cloud and container technologies
  • Experience with real-time data processing and Kafka
  • Experience with Scala, Hive, Impala, and HBase

Citi Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Citi and has not been reviewed or approved by Citi.

  • Healthcare Strength — Health coverage is presented as comprehensive, including free in-network preventive care, mental-health resources, and the Be Well Program. Materials also state new hires have access to health and insurance benefits from the outset.
  • Retirement Support — The retirement plan offers a $1-for-$1 match up to 6% of eligible pay. New employees are eligible for the plan, with automatic enrollment after 90 days if they do not enroll themselves.
  • Inclusive Benefits Coverage — Benefits highlight fertility treatment coverage, adoption/surrogacy reimbursement up to $30,000, and disability coverage. Coverage extends to spouses and domestic partners regardless of gender identity or sexuality, with gender-affirming care-related support noted.

Citi Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kwun Tong, Kowloon
223,850 Employees

What We Do

Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. We are Citi, the global bank – an institution connecting millions of people across hundreds of countries and cities.

Similar Jobs

Optum Logo Optum

Software Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Pune, Mahārāshtra, IND
160000 Employees

The Aerospace Corporation Logo The Aerospace Corporation

Sr Export Compliance Officer

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Remote or Hybrid
India
4600 Employees

CSC Logo CSC

Accountant

Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Remote or Hybrid
2 Locations
8500 Employees

Mondelēz International Logo Mondelēz International

Analytics Analyst

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
India
90000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account