Senior Big Data Engineer Pyspark Databricks - Vice President

Posted 9 Days Ago
Be an Early Applicant
Pune, Mahārāshtra, IND
In-Office
Senior level
Fintech • Financial Services
The Role
Lead design and delivery of data engineering solutions for Markets Business Control Tech. Build and maintain platforms, ensure code quality and testing, debug and secure applications, integrate with stakeholders and data scientists, and implement Delta Lakehouse, real-time Kafka ingestion, Databricks and S3 architectures.
Summary Generated by Built In

We are looking to hire experienced Data engineer to join our team responsible for building technology solutions for the Markets Business  Control Tech and for various business risk and controls functions. You will work with the Architects, Business stakeholders and Data Scientists to ensure we are meeting their requirements to develop and drive automation. This is an exciting opportunity to work on an important project for the group, which will have huge impact on the business and future design in this area.

Key Responsibilities:

 Evaluate and provide technical solutions to solve a variety of complex and interdependent processes.

  • Build and maintain the platform ensuring timely delivery of work items across the multiple initiatives/components.
  • Ensure all team members adhere to our code quality and testing standards.
  • Test and debug programs Coordinate with internal teams to understand user requirements and provide technical solutions.
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analysing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications.
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision.

Skills & Experience :

  • Experience Professional with 13+ Years of experience in Data engineering with good exposure on spark architecture
  • Good Exposure on PySpark , Spark  development experience, particularly on data processing and the associated modules
  • Work exposure  on ECS  , Kubernetes
  • Have worked on DeltaLakehouse and exposure on consuming real time messages via Kafka
  • Basic experience on Unix, hdfs and supported libraries such as PyArrow.  Any PySpark experience is preferred as the environment uses Hadoop and Spark and it supports python. 
  • Working knowledge of Databases (SQL) is required.
  • Working knowledge of BitBucket or equivalent SCM tool is required.
  • Knowledge of Apache Airflow is desirable Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals
  • Ability to multi-task and deliver to a tight deadline
  • Exposure on New age Data architecture using Databricks and S3

Good to Have :

  • Data Bricks Certification
  • PL/SQL exposure using traditional Databases
  • DWH and Datalakehouse concepts

------------------------------------------------------

Job Family Group: Technology

------------------------------------------------------

Job Family:Applications Development

------------------------------------------------------

Time Type:Full time

------------------------------------------------------

Most Relevant Skills Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills Required

  • 13+ years of experience in data engineering
  • Strong knowledge of Spark architecture
  • PySpark and Spark development experience
  • Experience with Databricks and S3-based architectures
  • Experience with Delta Lake / Lakehouse concepts
  • Experience consuming real-time messages via Kafka
  • Exposure to ECS and Kubernetes
  • Basic Unix and HDFS experience and familiarity with PyArrow
  • Working knowledge of SQL databases
  • Experience with BitBucket or equivalent SCM
  • Knowledge of Apache Airflow
  • Databricks certification
  • PL/SQL exposure
  • DWH and data lakehouse concepts

Citi Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Citi and has not been reviewed or approved by Citi.

  • Healthcare Strength Benefits coverage is positioned as comprehensive, including health, dental, and vision insurance plus on-site clinics, prescription drug support, and disability coverage. Family-building support such as fertility assistance is described as a notable differentiator within the overall package.
  • Retirement Support Retirement benefits are framed as strong, highlighted by a 401(k) with matching and additional plan options like a Roth 401(k). Financial support is reinforced through discounts and broader financial guidance resources tied to the benefits ecosystem.
  • Wellbeing & Lifestyle Benefits Wellbeing support extends beyond insurance through programs like an Employee Assistance Program, counseling/legal resources, and gym or wellness reimbursement. These offerings increase the perceived total rewards value even when cash compensation sentiment varies by role.

Citi Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kwun Tong, Kowloon
223,850 Employees

What We Do

Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. We are Citi, the global bank – an institution connecting millions of people across hundreds of countries and cities.

Similar Jobs

CrowdStrike Logo CrowdStrike

Engineer III – SIEM Integrations

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
Pune, Mahārāshtra, IND
11000 Employees
Hybrid
Pune, Mahārāshtra, IND
289097 Employees

CrowdStrike Logo CrowdStrike

Sr. Analyst, Tax Accounting

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
Pune, Mahārāshtra, IND
11000 Employees

CrowdStrike Logo CrowdStrike

Product Manager

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
Pune, Mahārāshtra, IND
11000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account