Tech - Data Engineer

Posted 27 Days Ago
Be an Early Applicant
Mumbai, Maharashtra, IND
In-Office
Mid level
Insurance • Financial Services
The Role
Designs, builds, and optimizes scalable data platforms, distributed systems, and high-volume ETL pipelines supporting trading and business operations. Develops solutions using Java, Python, Kafka, microservices, and modern databases while ensuring reliability, governance, data quality, and performance. Automates operational processes, improves application scalability, collaborates with trading and technology teams, and mentors junior engineers.
Summary Generated by Built In
Job Purpose

As a Data Engineer, you will design, build, and optimize scalable data platforms that support trading and business functions across global markets. You will architect high-performance data systems, develop robust ETL pipelines, and enable efficient processing of large-scale datasets while ensuring reliability, scalability, and data governance standards.

Responsibilities
  • Design, develop, and maintain large-scale data platforms and processing systems that support trading and business operations.
  • Build and optimize data ingestion, transformation, and storage solutions to improve performance, reliability, and operational efficiency.
  • Develop, manage, and enhance ETL pipelines capable of handling large-volume, high-frequency datasets.
  • Design and implement fault-tolerant, scalable, and distributed data architectures using modern engineering frameworks and technologies.
  • Leverage Java, Python, Kafka, and microservices-based architectures to build high-performance data engineering solutions.
  • Drive data governance, quality, and platform best practices while ensuring data consistency and integrity across systems.
  • Automate operational processes, optimize existing applications, and continuously improve system scalability and maintainability.
  • Collaborate closely with trading, technology, and business teams while mentoring junior engineers and contributing to the growth of the engineering organization.
Key Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related technical discipline with an understanding of financial markets and trading concepts.
  • 4+ years of experience in data engineering, data platform development, or large-scale data processing environments.
  • Strong programming skills in Java and Python with experience building enterprise-grade applications and services.
  • Experience working with microservices architectures, Spring Framework, and distributed systems.
  • Strong understanding of ETL development, data warehousing concepts, and large-scale data pipeline design.
  • Experience with messaging and streaming technologies such as Kafka and automation using shell scripting.
  • Hands-on experience with relational and analytical databases, preferably ClickHouse and PostgreSQL.
  • Knowledge of CI/CD practices and tools such as Jenkins, with a focus on automation and deployment reliability.
  • Experience designing scalable, fault-tolerant, and high-performance systems capable of handling large datasets.
  • Exposure to trading firms, capital markets, or international exchange data environments will be an added advantage.
  • Strong analytical, problem-solving, and communication skills with the ability to work effectively across cross-functional teams.
  • Demonstrated attention to detail, process orientation, continuous learning mindset, and the ability to mentor junior team members.

Skills Required

  • Bachelor's degree in Computer Science, Engineering, or a related technical discipline
  • Understanding of financial markets and trading concepts
  • 4+ years of experience in data engineering, data platform development, or large-scale data processing
  • Strong programming skills in Java and Python
  • Experience with enterprise-grade applications and services
  • Experience with microservices architectures, Spring Framework, and distributed systems
  • Strong understanding of ETL development, data warehousing, and large-scale data pipeline design
  • Experience with Kafka or similar messaging and streaming technologies
  • Experience with shell scripting and automation
  • Hands-on experience with relational and analytical databases, preferably ClickHouse and PostgreSQL
  • Knowledge of CI/CD practices and Jenkins
  • Experience designing scalable, fault-tolerant, high-performance systems handling large datasets
  • Exposure to trading firms, capital markets, or international exchange data environments
  • Strong analytical, problem-solving, and communication skills
  • Ability to work effectively across cross-functional teams
  • Ability to mentor junior team members
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Mumbai
270 Employees
Year Founded: 1995

What We Do

Edelweiss Financial Services Limited is an Indian diversified financial-services group. Its holding company provides investment-banking services and supports group entities through development, managerial, and financial functions. Across the group, it serves retail and institutional customers through advisory and fee-based services, lending and investments, life and general insurance, asset reconstruction, treasury activities, and asset-management businesses within a broad financial-services platform.

Similar Jobs

Cencora Logo Cencora

Cloud Engineer

Healthtech • Logistics • Pharmaceutical
In-Office
Pune, Maharashtra, IND
51000 Employees
Easy Apply
Remote or Hybrid
India
100 Employees

Mastercard Logo Mastercard

Lead Software Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

Mastercard Logo Mastercard

Senior Software Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Maharashtra, IND
38800 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account