The Role
Develop scalable real-time machine learning and data systems using Hadoop ecosystem technologies. Build batch and streaming ingestion and transformation frameworks for multimodal data, deploy models through Cloudera Machine Learning, create internal full-stack tools, and optimize application performance and resource utilization.
Summary Generated by Built In
- Experience working with ML platforms such as CML, Spark
MLlib, and Python ML libraries (scikit‑learn, XGBoost), including model
deployment.
- Design and develop highly scalable, Real time systems
using Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,
Ranger, Kafka, Flink and Nifi)
- Build robust data ingestion and transformation
frameworks using Java, Spark, Python, and shell scripting for ingesting
multi model data(image, audio, video, unstructured documents) with both
batch and real-time.
- Develop full‑stack applications and internal
engineering tools using Python, shell scripting, and modern web frameworks
(e.g., Flask, React).
- Collaborate closely with data scientists to
operationalize machine learning models using Cloudera Machine Learning
(CML).
- Perform performance tuning and optimization of data
applications on Hadoop to ensure optimal resource utilization.
Skills Required
- Experience working with ML platforms such as CML and Spark MLlib
- Experience with Python machine learning libraries including scikit-learn and XGBoost
- Experience with machine learning model deployment and operationalization
- Experience designing and developing scalable real-time systems using Hadoop ecosystem components
- Experience building data ingestion and transformation frameworks using Java, Spark, Python, and shell scripting
- Experience processing multimodal data including images, audio, video, and unstructured documents
- Experience developing full-stack applications and internal engineering tools using Python, shell scripting, Flask, React, or similar web frameworks
- Experience tuning and optimizing Hadoop data applications for resource utilization
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Technopals provides IT solutions to organizations, including IT security services, talent acquisition, enterprise IT infrastructure, and software development. Serving organizations across Asia Pacific and other global markets, it works with businesses of all sizes to help them meet infrastructure needs and gain value from technology. Its approach emphasizes established industry practices, client service, and practical IT solutions.
.jpeg)
