Data Engineer - Python, AI

Reposted 26 Days Ago
Be an Early Applicant
Pune, Mahārāshtra, IND
In-Office
Expert/Leader
Fintech • Financial Services
The Role
Build and optimize large-scale data and ETL pipelines using Python, PySpark, Pandas, and PyArrow. Develop NLP pipelines with Flair, BERT, and LLMs, deploy models through Flask APIs and MLflow, and integrate Redis, cloud services, CI/CD, scheduling, monitoring, testing, and microservices. Support production operations through Linux, shell scripting, Autosys, and application health monitoring.
Summary Generated by Built In

Role Summary
We are looking for a mid-level Python Developer with combined experience in Data Engineering and AI/NLP engineering. The candidate will build NLP pipelines using libraries such as Flair, BERT, and LLM frameworks, and will also work on large-scale data processing using PySpark, Pandas, and related data tools. The role includes developing APIs, integrating with platform services, and supporting CI/CD deployments using GitHub and LightSpeed Enterprise.

Key Responsibilities
  • Develop and optimize ETL/data processing jobs using PySpark, Pandas, PyArrow, and related libraries.
  • Build and maintain NLP pipelines using Flair, BERT, and LLM-based models.
  • Develop scalable ingestion and data transformation pipelines for AI and analytics use cases.
  • Build and maintain Flask-based APIs for model inference and service integrations.
  • Use regular expressions for text cleaning, parsing, and NLP preprocessing.
  • Integrate caching and fast lookups using Redis.
  • Manage and deploy ML models using MLflow for tracking and versioning.
  • Support CI/CD workflows using GitHub, LightSpeed Enterprise, and deployment pipelines.
  • Create and maintain Autosys JILs for job scheduling and automation.
  • Use basic Linux commands for troubleshooting, operations, and deployment tasks.
  • Monitor application and system health using ITRS Geneos.
  • Write unit tests and improve automation test coverage (PyTest/unittest).
  • Work with REST APIs, microservices, and basic shell scripting.
  • Work with cloud services (ECS), including boto3.
Required Skills
  • 10–12 years of hands-on Python programming experience.
  • Strong fundamentals in Python, OOP, and design patterns.
  • Experience with NLP libraries such as Flair, BERT, HuggingFace Transformers, or similar.
  • Solid experience with PySpark, Pandas, PyArrow, and distributed data pipelines.
  • Experience building APIs using Flask (FastAPI is a plus).
  • Experience with MLflow for model tracking and deployment.
  • Good understanding of CI/CD practices and Git workflows.
  • Experience working with Redis or similar in-memory stores.
  • Experience with Autosys JILs for job scheduling.
  • Comfortable with Linux command line and shell scripting.
  • Strong debugging, problem-solving, and teamwork skills.
  • Exposure to cloud services; AWS boto3 experience is an asset.
Nice-to-Have
  • Experience with Polars or Dask for high-performance data processing.
  • Experience with PyTorch or TensorFlow for model training.
  • Experience with Docker, Kubernetes, or containerized deployments.
  • Experience with monitoring tools such as ITRS Geneos.
  • Experience with FastAPI, Airflow, or Prefect.

------------------------------------------------------

Job Family Group: Technology

------------------------------------------------------

Job Family:Applications Development

------------------------------------------------------

Time Type:Full time

------------------------------------------------------

Most Relevant Skills Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills Required

  • 10-12 years of hands-on Python programming experience
  • Strong fundamentals in Python, object-oriented programming, and design patterns
  • Experience with NLP libraries such as Flair, BERT, HuggingFace Transformers, or similar
  • Experience with PySpark, Pandas, PyArrow, and distributed data pipelines
  • Experience building APIs using Flask
  • Experience with MLflow for model tracking and deployment
  • Understanding of CI/CD practices and Git workflows
  • Experience with Redis or similar in-memory stores
  • Experience with Autosys JILs for job scheduling
  • Comfort with Linux command line and shell scripting
  • Strong debugging, problem-solving, and teamwork skills
  • Exposure to cloud services and AWS boto3
  • Experience with Polars or Dask
  • Experience with PyTorch or TensorFlow
  • Experience with Docker, Kubernetes, or containerized deployments
  • Experience with monitoring tools such as ITRS Geneos
  • Experience with FastAPI, Airflow, or Prefect

Citi Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Citi and has not been reviewed or approved by Citi.

  • Healthcare Strength — Health coverage is presented as comprehensive, including free in-network preventive care, mental-health resources, and the Be Well Program. Materials also state new hires have access to health and insurance benefits from the outset.
  • Retirement Support — The retirement plan offers a $1-for-$1 match up to 6% of eligible pay. New employees are eligible for the plan, with automatic enrollment after 90 days if they do not enroll themselves.
  • Inclusive Benefits Coverage — Benefits highlight fertility treatment coverage, adoption/surrogacy reimbursement up to $30,000, and disability coverage. Coverage extends to spouses and domestic partners regardless of gender identity or sexuality, with gender-affirming care-related support noted.

Citi Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kwun Tong, Kowloon
223,850 Employees

What We Do

Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. We are Citi, the global bank – an institution connecting millions of people across hundreds of countries and cities.

Similar Jobs

Citigroup Logo Citigroup

Data Engineer

Financial Services
Hybrid
Pune, Mahārāshtra, IND
226610 Employees

Canonical Logo Canonical

Software Engineer

Cloud • Software
In-Office or Remote
7 Locations
880 Employees
2K-2K Annually

Cin7 Logo Cin7

Software Engineer

Cloud • eCommerce • Logistics • Software
Easy Apply
Hybrid
Pune, Mahārāshtra, IND
276 Employees
3M-4M Annually

Cin7 Logo Cin7

Junior Software Engineer

Cloud • eCommerce • Logistics • Software
Easy Apply
Hybrid
Pune, Mahārāshtra, IND
276 Employees
2M-3M Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account