Senior Data Engineer - AI/ML

Posted 3 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Fintech • Payments • Software • Financial Services • Automation
The Role
The Senior Data Engineer will design and optimize scalable data pipelines, implement real-time streaming pipelines, collaborate with data scientists, and oversee CI/CD and data quality practices.
Summary Generated by Built In

We are looking for a highly skilled Senior Data Engineer to join our Data Engineering chapter within the Technology Platform domain. The ideal candidate will have strong expertise in real-time data streaming, modern data platforms, and AI/ML operationalization (AIOps/MLOps/LLMOps).

You will be responsible for designing, building, and optimizing scalable data pipelines and enabling advanced analytics and AI-driven solutions.


RequirementsKey Responsibilities
  • Design and implement real-time data streaming pipelines using Kafka and related technologies
  • Build and maintain scalable data engineering solutions on Cloudera platform
  • Develop and optimize ETL/ELT pipelines for large-scale structured and unstructured data
  • Collaborate with data scientists to deploy and manage ML models (MLOps/LLMOps frameworks)
  • Implement and manage CI/CD pipelines for data and ML workflows
  • Work with OpenShift/Kubernetes for containerized deployments
  • Ensure data quality, governance, and security best practices
  • Monitor, troubleshoot, and optimize data workflows and infrastructure
  • Partner with cross-functional teams including product, engineering, and analytics
Required Skills & Experience
  • 6+ years of experience in Data Engineering
  • Strong hands-on experience with Apache Kafka (Real-Time Streaming - RTS)
  • Expertise in Cloudera Data Platform (CDP) or similar big data ecosystems
  • Experience with CI/CD pipelines (Jenkins, GitLab, etc.)
  • Hands-on experience with OpenShift/Kubernetes
  • Strong programming skills in Python/Scala/Java
  • Experience with distributed data processing frameworks (Spark, Hive, etc.)
  • Good understanding of data modeling and data warehousing concepts
Preferred Skills
  • Experience in AIOps, MLOps, or LLMOps
  • Exposure to AI/ML lifecycle management and deployment
  • Knowledge of cloud platforms (AWS/Azure/GCP) is a plus
  • Experience in banking or financial services domain
Soft Skills
  • Strong problem-solving and analytical thinking
  • Excellent communication and stakeholder management
  • Ability to work in agile and fast-paced environments

Top Skills

AWS
Azure
Ci/Cd
Cloudera
GCP
Hive
Java
Kafka
Kubernetes
Openshift
Python
Scala
Spark
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Dubai Internet City
160 Employees
Year Founded: 1997

What We Do

Global Software Solutions Group Veracious product line is a series of robust banking platforms that provide core banking, payment systems, custom process automation, and document management solutions for banks and financial institutions in Middle East & Africa. This cutting-edge product line features the Veracious Payments Hub, Digital Banking and the DMS, all built on the Torus Lowcode development platform software. Global Software Solutions Group is a software solutions provider that aims to solve mission-critical problems that financial institutions face today. Our software solutions bring together our Low Code platform, the payments product line and customized service offerings to solve mission-critical statements in core banking, payments, process automation, and document management. The Payments Hub is GSS's flagship product.

Similar Jobs

DigitalOcean Logo DigitalOcean

Support Engineer

Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
1400 Employees

CrowdStrike Logo CrowdStrike

Threat Researcher III (Remote, IND)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
India
10000 Employees

CrowdStrike Logo CrowdStrike

Sr. Threat Researcher (Remote, IND)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
India
10000 Employees

MetLife Logo MetLife

Team Leader - Technology Services

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
India
43000 Employees
6-6 Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account