Pyspark Senior Data Engineer - PUNE

Posted 16 Days Ago
Be an Early Applicant
2 L, Sri Ganganagar, Rajasthan
Senior level
Fintech
The Role
The role involves building and maintaining data pipelines, ensuring data accuracy, and optimizing infrastructure for data extraction and transformation. Responsibilities include automating workflows, providing user support, and acting as a subject matter expert for stakeholders while ensuring compliance with laws and regulations.
Summary Generated by Built In

The Applications Development member (data engineering senior programmer) is an intermediate level position responsible for participation in the establishment and implementation of new or revised data platform eco systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to data engineering scrum team to implement the business requirements:


Responsibilities:

  • Build and maintain batch or real-time data pipelines in data platform. 
  • Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources.
  • Develop ETL (extract, transform, load) processes to help extract and manipulate data from multiple sources. 
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Automate data workflows such as data ingestion, aggregation, and ETL processing. 
  • Prepare raw data in Data Warehouses into a consumable dataset for both technical and non-technical stakeholders. 
  • Build, maintain, and deploy data products for analytics and data science teams on data platform
  • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
  • Monitor data systems performance and implement optimization solution.
  • Has the ability to operate with a limited level of direct supervision.
  • Can exercise independence of judgement and autonomy.
  • Acts as SME to senior stakeholders and /or other team members.
  • Serve as advisor or coach to new or lower level analysts
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.


Qualifications:

  • 5+ years of relevant experience in Data engineering role
  • Advanced SQL/ RDBMS skills and experience with relational databases and database design. 
  • Strong proficiency in object-oriented languages: Python, PySpark is must
  • Experience working with Bigdata - Hive/Impala/S3/HDFS
  • Experience working with data ingestion tools such as Talend or Ab Initio.
  • Nice to working with data lakehouse architecture such as AWS Cloud/Airflow/Starburst/Iceberg
  • Strong proficiency in scripting languages like Bash, UNIX Shell scripting
  • Strong proficiency in data pipeline and workflow management tools
  • Strong organizational skills. 
  • Excellent problem-solving, communication, and organizational skills. 
  • Proven ability to work independently and with a team.
  • Experience in managing and implementing successful projects
  • Ability to adjust priorities quickly as circumstances dictate
  • Consistently demonstrates clear and concise written and verbal communication


Education:

  • Bachelor’s degree/University degree or equivalent experience

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Citi is an equal opportunity and affirmative action employer.

Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Citigroup Inc. and its subsidiaries ("Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View the "EEO is the Law" poster. View the EEO is the Law Supplement.

View the EEO Policy Statement.

View the Pay Transparency Posting

Top Skills

Pyspark
Python
SQL
The Company
HQ: New York, NY
223,850 Employees
Hybrid Workplace

What We Do

Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. We are Citi, the global bank – an institution connecting millions of people across hundreds of countries and cities.

Similar Jobs

2 L, Sri Ganganagar, Rajasthan, IND
26747 Employees
2 L, Sri Ganganagar, Rajasthan, IND
223850 Employees

S&P Global Logo S&P Global

Data Engineer-Gen AI

Fintech • Analytics
2 L, Sri Ganganagar, Rajasthan, IND
26747 Employees
Jaipur, Rajasthan, IND
369 Employees

Similar Companies Hiring

EDGE Thumbnail
Software • Fintech • Financial Services • Analytics
Chicago, IL
20 Employees
Bectran, Inc Thumbnail
Software • Machine Learning • Information Technology • Fintech • Automation • Artificial Intelligence
Schaumburg, IL
51 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account