PySpark Big Data Developer

Reposted 4 Days Ago
Be an Early Applicant
Pune, Mahārāshtra, IND
In-Office
Mid level
Fintech • Financial Services
The Role
Develop and maintain big data pipelines using PySpark, perform end-to-end application development and quality assurance, working with teams for integration and execution.
Summary Generated by Built In

Excited to grow your career?

We value our talented employees, and whenever possible strive to help one of our associates grow professionally before recruiting new talent to our open positions. If you think the open position you see is right for you, we encourage you to apply!

Our people make all the difference in our success.

--------------------------------------------------------------

Market sales Technology is going through several transformational technology initiatives and is looking for Automation Tester to join the global Testing Center of Excellence. This role is based in Pune but it is part of a virtual team with other team members based in the US and India.

Description

  • Work with a cross-functional and geographically dispersed team for quality assurance
  • Perform end to end features development of application including requirements understanding, impact analysis, development and execution, production deployment and maintenance.
  • Work with multiple teams to develop, and execute features
  • Work with teams in a collaborative style to engage partners and proactively manage activities.

Skills

  • At least 4+ years’ experience in Python, SQL and PySpark.
  • Proficiency in distributed data processing and big data tools and technologies: Hadoop, HDFS, YARN, Spark, Hive
  • API's and backend development (FASTAPI / FLASK)
  • Devops: GIT, CI/CD basics, Linux/Unix commands
  • Design, develop, and maintain big data pipelines using PySpark
  • Experience with integration of data from multiple data sources
  • Experience in DevTools like openshift, teamcity, uDeploy, BitBucket, GitHub
  • Proactively contribute to stability of overall production systems and troubleshoot key components and processes
  • Keep track of latest technology trends and proactively learn new technologies driving practical and reference implementations

Nice to have:

  • Experience with NoSQL databases, such as ElasticSearch
  • understand of LLMs, prompt engineering, Data qyery systems (NL to SQL), basic knowledge of vector databases (FAISS, pinecone etc) 

Qualifications:

  • Bachelor’s degree (preferably in technology /engineering or related field).

What we offer:

  • Opportunity for professional development in the international and multicultural organization
  • Unique opportunity to participate in global investment banking projects
  • Internal and external trainings
  • Developing opportunities and challenging assignments
  • Attractive and stable employment conditions
  • Social benefits (medical care, Benefit System, life insurance, pension scheme)
  • Flexible working hours

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Top Skills

Ci/Cd
Elasticsearch
Fastapi
Flask
Git
Hadoop
Hdfs
Hive
Linux/Unix
Pyspark
Python
Spark
SQL
Yarn
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kwun Tong, Kowloon
223,850 Employees

What We Do

Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. We are Citi, the global bank – an institution connecting millions of people across hundreds of countries and cities.

Similar Jobs

Citi Logo Citi

Data Engineer

Fintech • Financial Services
In-Office
Pune, Mahārāshtra, IND
223850 Employees

TransUnion Logo TransUnion

Information Security Senior Analyst

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
2 Locations
13000 Employees

Capco Logo Capco

Project Manager

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Mastercard Logo Mastercard

Designer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Mahārāshtra, IND
38800 Employees

Similar Companies Hiring

Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account