Big data/Python/Databricks Engineer Engineer

Posted 9 Hours Ago
Be an Early Applicant
2 Locations
In-Office
Senior level
Fintech • Financial Services
The Role
Build and maintain scalable data pipelines using Python, PySpark, Hadoop, Databricks, and Oracle. Optimize distributed data workflows, support the full application development lifecycle, administer Linux-based processes, and collaborate on Tableau reporting. The role also involves data governance, risk assessment, production support, technical planning, and large language model expertise within Citi’s enterprise data infrastructure.
Summary Generated by Built In

Citi is looking for an Applications Development Intermediate Programmer Analyst to design, build, and maintain large-scale data engineering solutions that support critical reporting and analytics functions across a global financial institution. In this role, you will develop and optimize data pipelines, work across distributed computing platforms, and contribute to the full lifecycle of data application delivery. This is an opportunity to work within a high-impact technology team that operates at the core of Citi's data infrastructure.

Responsibilities

  • Build and maintain scalable data pipelines using Python and PySpark to process and transform large volumes of structured and unstructured data across distributed platforms.
  • Develop and optimize data workflows on Hadoop-based ecosystems, including HDFS, Hive  ensuring reliable data availability for downstream reporting and analytics.
  • Conduct feasibility studies, time and cost estimates, and technical planning activities to support data engineering delivery across business areas.
  • Monitor and manage all phases of the data application development lifecycle, from analysis and design through to testing, implementation, and production support.
  • Collaborate with analytics and reporting teams to build and maintain Tableau dashboards and translating raw data into actionable business insights.
  • Administer and troubleshoot data processes within Linux environments, ensuring stability, performance, and operational continuity.
  • Assess risk across data engineering decisions, ensuring solutions align with security, data governance, and compliance standards.
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

Required Qualifications & Skills

  • 5 to 8 years of experience in data engineering, big data development, or software application development with a focus on large-scale data platforms.
  • Hands-on development experience using Python and PySpark for data ingestion, transformation, and pipeline orchestration at scale.
  • Expert in ETL and Oracle DB, SQL
  • Knowledge in Data bricks
  • Practical knowledge of Hadoop ecosystem components including HDFS, Hive, and Hadoop cluster operations, with familiarity with Ozone storage.
  • Working experience in Linux environments, including scripting, job scheduling, and process management.
  • Experience building or supporting Tableau dashboards and reports to deliver data insights to business stakeholders.
  • Familiarity with RStudio for statistical analysis or data exploration in a data engineering context.
  • Deep expertise in Large Language Models (LLMs) including OpenAI, Gemini, Claude, Llama, and local/open‑source models
  • Bachelor's degree or equivalent experience in a relevant technical discipline.

Beneficial Skills & Qualifications

  • Experience working with cloud-native data platforms or migrating workloads from on-premise Hadoop environments to modern data platforms.
  • Knowledge of data governance practices, metadata management, or data quality frameworks within large-scale environments.
  • Familiarity with consulting or project management techniques applied within a technology delivery context.

What We Offer

At Citi, you will work within a collaborative and performance-driven global technology team where your contributions directly support the data infrastructure underpinning one of the world's leading financial institutions. This role offers technical depth, meaningful delivery ownership, and the opportunity to grow your expertise across big data and analytics platforms.

  • Hybrid working model with 2 days in the office and 3 days working remotely, supporting a sustainable work-life balance.
  • Opportunity to work on large-scale, real-world data engineering challenges using modern big data tools and platforms at enterprise scale.
  • Access to continuous learning and development resources to deepen technical skills across data engineering, analytics, and cloud technologies.
  • Autonomy to make technical decisions and operate with limited direct supervision, with the opportunity to act as a subject matter expert to senior stakeholders.
  • A structured career pathway with clear progression opportunities within Citi's global technology organization.
  • Competitive financial wellbeing and benefits package aligned to your location and level.

------------------------------------------------------

Job Family Group: Technology

------------------------------------------------------

Job Family:Applications Development

------------------------------------------------------

Time Type:Full time

------------------------------------------------------

Most Relevant Skills Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills Required

  • 5 to 8 years of experience in data engineering, big data development, or software application development focused on large-scale data platforms
  • Hands-on experience using Python and PySpark for large-scale data ingestion, transformation, and pipeline orchestration
  • Expertise in ETL, Oracle Database, and SQL
  • Knowledge of Databricks
  • Practical knowledge of Hadoop, HDFS, Hive, Hadoop cluster operations, and Ozone storage
  • Experience working in Linux environments, including scripting, job scheduling, and process management
  • Experience building or supporting Tableau dashboards and reports
  • Familiarity with RStudio for statistical analysis or data exploration
  • Deep expertise in large language models, including OpenAI, Gemini, Claude, Llama, and local or open-source models
  • Bachelor's degree or equivalent experience in a relevant technical discipline
  • Experience with cloud-native data platforms or migrating workloads from on-premise Hadoop environments
  • Knowledge of data governance, metadata management, or data quality frameworks
  • Familiarity with consulting or project management techniques in technology delivery

Citi Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Citi and has not been reviewed or approved by Citi.

  • Healthcare Strength Benefits coverage is positioned as comprehensive, including health, dental, and vision insurance plus on-site clinics, prescription drug support, and disability coverage. Family-building support such as fertility assistance is described as a notable differentiator within the overall package.
  • Retirement Support Retirement benefits are framed as strong, highlighted by a 401(k) with matching and additional plan options like a Roth 401(k). Financial support is reinforced through discounts and broader financial guidance resources tied to the benefits ecosystem.
  • Wellbeing & Lifestyle Benefits Wellbeing support extends beyond insurance through programs like an Employee Assistance Program, counseling/legal resources, and gym or wellness reimbursement. These offerings increase the perceived total rewards value even when cash compensation sentiment varies by role.

Citi Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kwun Tong, Kowloon
223,850 Employees

What We Do

Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. We are Citi, the global bank – an institution connecting millions of people across hundreds of countries and cities.

Similar Jobs

Ericsson Logo Ericsson

Inbound Supply Manager

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Hybrid
Pune, Mahārāshtra, IND
88000 Employees

Zscaler Logo Zscaler

Senior SOC Analyst

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
India
8697 Employees

Capco Logo Capco

Managing Principal -Project Program Portfolio Mgmt - Portfolio Manager

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

SailPoint Logo SailPoint

Sales Executive

Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
India
2461 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account