Senior Data Platform Engineer

Posted An Hour Ago
Be an Early Applicant
2 Locations
Hybrid
Senior level
Financial Services
The Role
Designs, builds, and operates scalable enterprise data services for ingestion, transformation, reconciliation, data quality, controls, and operational intelligence. Develops batch, streaming, and event-driven workloads using Scala, Spark, Python, Java, Databricks, AWS, and Kafka. Builds APIs, microservices, reusable processing frameworks, and AI-enabled data services while ensuring reliability, observability, performance, governance, and disaster recovery. Owns production systems and delivers configurable lakehouse capabilities for regulated enterprise environments.
Summary Generated by Built In

We are seeking a highly skilled, hands-on Senior Data Platform Engineer to design, build and manage complex, high-performance enterprise data services supporting data integration, reconciliation, data controls, data quality and operational intelligence.

The role combines strong software engineering expertise with distributed data processing, cloud-native architecture and modern lakehouse technologies. The successful candidate will develop reusable, scalable and resilient data services supporting high-volume batch and real-time processing across enterprise applications.


Key Responsibilities:-

  • Enterprise Data Services Engineering: Architect, develop and maintain complex, reusable data services for data ingestion, transformation, standardisation, validation, reconciliation and data processing using Scala, Spark, Python and Java.
  • Data Integration & Processing: Build scalable integration frameworks supporting files, databases, APIs, Kafka, CDC and enterprise messaging, including batch, near-real-time and streaming ingestion.
  • Reconciliation & Matching Engines: Develop high-performance reconciliation services supporting complex matching rules, multi-pass matching, tolerance handling, one-to-one and many-to-many matching, balance proofing and exception generation.
  • Data Controls & Integrity: Engineer reusable control frameworks for completeness, accuracy, timeliness, record counts, control totals, source-to-target validation, auditability, data lineage, replay and recovery.
  • Data Quality Engineering: Develop configurable data quality services supporting schema validation, business rules, profiling, anomaly detection, data quality scoring, exception handling and automated remediation.
  • Databricks & Lakehouse Engineering: Build and optimise distributed processing workloads using Databricks, Apache Spark, S3, Apache Iceberg, Delta Lake, Unity Catalog and Lakeflow orchestration.
  • Streaming & Event-Driven Services: Develop Kafka/MSK-based event-processing services, CDC integration, stateful streaming, checkpointing, deduplication and reliable event delivery.
  • Software & API Development: Design and develop REST APIs, microservices, metadata-driven processing frameworks, configuration services and reusable libraries using Scala, Java/Spring Boot and Python.
  • AI & Intelligent Data Services: Integrate AI/ML capabilities for intelligent matching, anomaly detection, data quality remediation, metadata discovery and AI-assisted data processing.
  • Cloud Engineering, DevOps & Reliability: Implement AWS infrastructure, Terraform, CI/CD, automated testing, observability, performance optimisation, FinOps, production support and disaster recovery.

Essential Technical Skills:-

  • Software Engineering: Strong hands-on Scala, Java or Python development, object-oriented design, concurrency, distributed systems and software design patterns.
  • Distributed Processing: Apache Spark, Scala Spark, PySpark, Spark SQL, Structured Streaming and performance tuning.
  • Cloud & Lakehouse: AWS, Databricks, S3, Apache Iceberg, Delta Lake and Unity Catalog.
  • Data Integration: Kafka/MSK, CDC, REST APIs, JDBC, file processing and enterprise messaging.
  • Data Services: Data transformation, reconciliation, rule engines, data validation, data controls, data quality and exception processing.
  • Application Development: Microservices, REST APIs, Spring Boot/FastAPI, metadata-driven frameworks and service integration.
  • Data Engineering: SQL, data modelling, schema evolution, partitioning, incremental processing and data optimisation.
  • DevOps & SRE: Terraform, Docker, Git, CI/CD, automated testing, CloudWatch, OpenTelemetry and production troubleshooting.

Desirable Skills:-

  • Experience developing enterprise reconciliation or financial data processing platforms.
  • Real-time matching, balance proofing and stateful stream processing.
  • AI/ML, MLflow, vector search, RAG and agentic AI integration.
  • MongoDB Atlas, PostgreSQL/Aurora and enterprise workflow integration.
  • Financial services data governance, regulatory controls and operational resilience.

Experience

  • 8+ years of hands-on software development and data platform engineering.
  • Proven experience building complex, high-throughput distributed data services.
  • Strong development experience with Scala/Spark and cloud-native architectures.
  • Experience designing reusable frameworks rather than only implementing ETL pipelines.
  • Demonstrated ownership of production systems, performance, reliability and scalability.
  • Experience delivering enterprise-scale platforms within regulated environments preferred.

Expected Outcomes:-

  • Scalable, reusable enterprise data services.
  • High-performance batch and streaming reconciliation processing.
  • Automated, auditable data quality and control frameworks.
  • Reliable and cost-efficient Databricks/AWS workloads.
  • Production-ready services with strong observability, resilience and automated recovery.
  • Accelerated onboarding of new data sources and business use cases through configurable, self-service capabilities.

Education:

  • Bachelor’s degree/University degree or equivalent experience
  • Master’s degree preferred

------------------------------------------------------

Job Family Group: Technology

------------------------------------------------------

Job Family:Applications Development

------------------------------------------------------

Time Type:Full time

------------------------------------------------------

Most Relevant Skills Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills Required

  • Bachelor's degree, university degree, or equivalent experience
  • 8+ years of hands-on software development and data platform engineering experience
  • Strong hands-on experience with Scala, Java, or Python development
  • Experience with object-oriented design, concurrency, distributed systems, and software design patterns
  • Experience with Apache Spark, Scala Spark, PySpark, Spark SQL, Structured Streaming, and performance tuning
  • Experience with AWS, Databricks, S3, Apache Iceberg, Delta Lake, and Unity Catalog
  • Experience with Kafka/MSK, CDC, REST APIs, JDBC, file processing, and enterprise messaging
  • Experience building data transformation, reconciliation, rule engine, validation, data control, data quality, and exception-processing services
  • Experience developing microservices, REST APIs, Spring Boot or FastAPI, metadata-driven frameworks, and service integrations
  • Experience with SQL, data modeling, schema evolution, partitioning, incremental processing, and data optimization
  • Experience with Terraform, Docker, Git, CI/CD, automated testing, CloudWatch, OpenTelemetry, and production troubleshooting
  • Proven experience building complex, high-throughput distributed data services
  • Experience designing reusable frameworks rather than only implementing ETL pipelines
  • Demonstrated ownership of production systems, performance, reliability, and scalability
  • Master's degree
  • Experience delivering enterprise-scale platforms within regulated environments
  • Experience developing enterprise reconciliation or financial data processing platforms
  • Experience with AI/ML, MLflow, vector search, RAG, or agentic AI integration
  • Experience with MongoDB Atlas, PostgreSQL/Aurora, and enterprise workflow integration
  • Experience with financial services data governance, regulatory controls, and operational resilience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
226,610 Employees
Year Founded: 1998

What We Do

Citigroup is a global diversified financial services holding company serving consumers, corporations, governments and institutions. It provides consumer banking and credit, corporate and investment banking, securities brokerage, trade and securities services, and wealth management. Operating across nearly 160 countries and jurisdictions, Citi aims to be a leading partner for institutions with cross-border needs, a global wealth manager, and a valued personal bank in the United States.

Similar Jobs

Citigroup Logo Citigroup

Platform Engineer

Financial Services
Hybrid
Pune, Mahārāshtra, IND
226610 Employees

Citi Logo Citi

Platform Engineer

Fintech • Financial Services
In-Office
Pune, Mahārāshtra, IND
223850 Employees

Avaloq Logo Avaloq

Platform Engineer

Information Technology • Consulting
In-Office
Pune, Mahārāshtra, IND
2397 Employees

Ericsson Logo Ericsson

Supply Chain Planner

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Hybrid
2 Locations
88000 Employees

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account