The Role
Fine-tune open-source LLMs from experimentation through production on AWS. Run SFT and alignment methods including GRPO and DPO, debug distributed multi-GPU training, resolve loss and memory issues, and collaborate with evaluation and data engineering teams to improve accuracy. Scale models from 8B to 70B parameters based on offline metrics.
Summary Generated by Built In
Job Title:ML / Fine-Tuning Engineer
Location: Hyderabad OR Pune
Notice Period : 0-30 Days
Mode of Work:Hybrid
Experience :5+ Years
We are looking for ML / Fine-Tuning Engineer who can deliver (under supervision of ProServe Tech Lead) the end-to-end
fine-tuning of open-source LLMs for a narrow, high-volume production task on
AWS — SFT and alignment experiments (GRPO, DPO), debugging training on
multi-GPU clusters, and iterating to strict accuracy targets. Models from 8B to
70B parameters.
What We Expect:
- Fine-tune
open-source LLMs (Qwen, Llama) from experiment to production-ready
checkpoint
- Run
SFT and RL alignment (GRPO, DPO) to improve output accuracy
- Execute
training on AWS GPU instances (p4d, p5, g5) using distributed training
- Diagnose/fix
training issues: loss imbalances, OOM errors, gradient instabilities
- Collaborate
with evaluation and data engineering to iterate on quality gaps
- Make
data-driven model scaling decisions (8B → 14B → 70B)
based on offline metrics
Requirements
- Experience: 5+
years ML engineering, with 2+ years in LLM fine-tuning
- LLM
Models: Hands-on with open-source LLMs — Qwen and Llama
required
- Training
Methods: SFT, LoRA/QLoRA, GRPO, DPO/RLHF
- Frameworks: NVIDIA
NeMo/NeMoRL, VeRL, HuggingFace TRL — must have used at least two
- Distributed
Training: DeepSpeed ZeRO, FSDP2, multi-node GPU orchestration
- AWS
Infrastructure: p4d/p5/g5 GPU instances, SageMaker Training Jobs
- Languages: Python,
PyTorch; CUDA debugging a plus
Preferred (Not Required): Fine-tuning for
tool-calling/agent tasks; multi-node GRPO/RLHF with NeMoRL or VeRL; tokenizer
internals and chat-template rendering for tool-use formats.
Benefits
- Comprehensive Medical Coverage:
Health insurance of INR 5.0 Lakhs for you and your family (up to 6 members), ensuring complete peace of mind. - Robust Protection Plans:
Group Personal Accident Insurance and Group Term Life Insurance to safeguard you and your loved ones. - Retirement Benefits:
PF and Gratuity provided as per standard government regulations. - Flexible Work Options:
Enjoy hybrid work arrangements & flexible working hours. - Generous Leave Policy:
21 days of annual leave, in addition to 10 company-declared holidays. - Employee Well-being Spaces:
Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation.
Skills Required
- 5+ years of machine learning engineering experience
- 2+ years of LLM fine-tuning experience
- Hands-on experience with open-source Qwen and Llama models
- Experience with SFT, LoRA, QLoRA, GRPO, DPO, and RLHF
- Experience with at least two of NVIDIA NeMo or NeMoRL, VeRL, and Hugging Face TRL
- Experience with DeepSpeed ZeRO, FSDP2, and multi-node GPU orchestration
- Experience using AWS p4d, p5, or g5 GPU instances
- Experience with SageMaker Training Jobs
- Proficiency in Python and PyTorch
- CUDA debugging experience
- Fine-tuning for tool-calling or agent tasks
- Multi-node GRPO or RLHF using NeMoRL or VeRL
- Tokenizer internals and chat-template rendering for tool-use formats
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
DATAECONOMY is a global, cloud-first data and AI consultancy delivering enterprise-grade solutions through an innovative intellectual-property suite. Its work spans data and BI platform modernization, self-service AI, data mesh and fabric, master data management, governance, cloud enablement, digital engineering, knowledge graphs, and machine lakes supporting cybersecurity and financial-crime use cases for enterprise clients.






