Senior Data Engineer

Posted Yesterday
Be an Early Applicant
Pune, Mahārāshtra, IND
Hybrid
Senior level
Financial Services
The Role
Designs and develops scalable enterprise data architecture, warehouses, data products, models, pipelines, integrations, and APIs. Implements data governance, quality controls, lineage, metadata, security, monitoring, and documentation. Provides technical leadership and mentorship while collaborating with business and technology stakeholders. Contributes to DevOps, CI/CD, testing, production stability, and strategic technical decisions. Requires expertise in distributed data systems, cloud technologies, databases, financial services, and trading data.
Summary Generated by Built In

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Responsibilities:

  • Develop data warehouse, develop data as a product, lead architect and solution, development, maintenance of scalable and secure data architecture to support downstream and reporting application and data integration, and simplify complex data processes utilizing best engineering practices and data lifecycle management

·        Develop data models, taxonomies, metadata, data mappings, data standards, versioning, and semantic layers for domains and data products and support data consumption, AI and regulatory requirements.

·        Build automated data integration solutions and data pipelines including reference data to meet business and reporting requirements

  • Exhibit strong leadership qualities, fostering a positive and collaborative work environment, providing guidance and mentorship to team members, and promoting a culture of continuous learning.

·        Implement data governance and management, quality standards and data controls to ensure data accuracy and security so downstream applications can consume data confidently.  Manage and maintain data process documentation

·        Define Contribute to technical direction and enhancement as a technical expert in data development and implementation phases, providing in-depth and sophisticated analyses to define problems and develop innovative solutions

  • Work closely with business users, stakeholders, BAs, product managers and other development teams to understand problem space, brainstorm ideas, approaches, and solutions.
  • Contribute to CI/CD implementation using DevOps best practices and ensure robust testing framework is utilized for functional and nonfunctional testing for the release cycles based on industry and Citi standards and work to implement them.
  • Work closely with business users, stakeholders, BAs, product managers and other development teams to understand problem space, brainstorm ideas, approaches, and solutions.

·        Contribute to technical direction and strategic decisions as a technical expert in all development and implementation phases, providing in-depth and sophisticated analyses to define problems and develop innovative solutions

  • Demonstrate a data-driven approach to problem-solving and decision-making, utilizing metrics, and performance indicators to assess team efficiency and identify improvement opportunities.
  • Manage and maintain data processes and jobs. Partner with Support team to ensure stability of production environment with proactive monitoring and health checks.
  • Partner with other Citi development teams to build APIs, integrations and share components that are critical to our platform’s success.

Qualifications:

  • Strong experience in designing and building best in class enterprise data engineering excellence in a highly matrixed, complex organization
  • Strong experience in architecting complex end-to-end data pipelines in a highly available, distributed systems of data extraction, ingestion, processing of large data sets.
  • Strong hands-on in advanced development experience in large database, complex data models, procedures, error handling, performance tuning/profiling, data security, database optimization and configurations.
  • Solid experience in complex data integration
  • Strong experience in large complex physical and logical data model design and development for data warehouse, reporting and reference and master data.
  • Hands-on experience with complex data integration and developing scalable, high-volume data pipelines using APIs, Python, Airflow, and Spark
  • Experience in data mesh technologies Trino/Starburst, S3, distributed stream processing Kafka
  • Strong experience in developing data quality and reconciliation controls, data lineage and data catalog documentations, data control monitoring and proactively identify and resolve data inconsistency and gaps
  • Excellent verbal and written communication skills, enabling effective collaboration with cross-functional teams, stakeholders, and management.
  • Strong hands-on experience in S3, Starburst, Oracle database, Databricks and Snowflake preferred.
  • Strong hands-on experience with modern software paradigms including cloud-native (AWS, Docker) and microservices
  • Experience in implementation of DevOps such as CI/CD and modern best practices such as testing frameworks and the SOLID principles; CI/CD tooling, automation of testing tools
  • Passion and commitment for adopting new technologies with exploratory mind-set
  • Experience working in an Agile/Scrum work environment
  • Experience in building observability and monitoring for data processes and jobs
  • Innovative ideas and can-do attitude to work under pressure
  • Experience in building data quality control and monitoring
  • Understanding trading data and experience working in the financial services is required
  • Proficiency with modern AI coding and testing tools
  • Development DBA experience in a plus.

Recommended Qualifications:

  • 7 to 10 years of relevant experience
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

Education:

  • Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.


------------------------------------------------------

Job Family Group: Technology

------------------------------------------------------

Job Family:Applications Development

------------------------------------------------------

Time Type:Full time

------------------------------------------------------

Most Relevant Skills Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills Required

  • Bachelor's degree, university degree, or equivalent experience
  • 7 to 10 years of relevant experience
  • Experience designing and building enterprise data engineering solutions
  • Experience architecting complex end-to-end data pipelines for large data sets and distributed systems
  • Advanced development experience with large databases, complex data models, performance tuning, data security, and database optimization
  • Experience with complex data integration
  • Experience designing and developing physical and logical data models for data warehouses, reporting, reference data, and master data
  • Hands-on experience with APIs, Python, Airflow, and Spark
  • Experience with Trino or Starburst, S3, and Kafka
  • Experience developing data quality, reconciliation, lineage, catalog, and data control monitoring solutions
  • Experience with S3, Starburst, Oracle, Databricks, and Snowflake
  • Experience with AWS, Docker, cloud-native software, and microservices
  • Experience implementing DevOps, CI/CD, automated testing, and modern software engineering practices
  • Experience working in an Agile/Scrum environment
  • Experience building observability and monitoring for data processes and jobs
  • Understanding of trading data and experience in financial services
  • Proficiency with modern AI coding and testing tools
  • Development DBA experience
  • Experience in systems analysis and application programming
  • Experience managing and implementing successful projects
  • Strong verbal and written communication skills
  • Ability to work under pressure and manage deadlines or changing requirements
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
226,610 Employees
Year Founded: 1998

What We Do

Citigroup is a global diversified financial services holding company serving consumers, corporations, governments and institutions. It provides consumer banking and credit, corporate and investment banking, securities brokerage, trade and securities services, and wealth management. Operating across nearly 160 countries and jurisdictions, Citi aims to be a leading partner for institutions with cross-border needs, a global wealth manager, and a valued personal bank in the United States.

Similar Jobs

In-Office
Pune, Mahārāshtra, IND
233 Employees
Hybrid
2 Locations
226610 Employees
Hybrid
2 Locations
226610 Employees
In-Office
Pune, Mahārāshtra, IND
335 Employees

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account