ML / Fine-Tuning Engineer

Posted 7 Days Ago
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Big Data • Cloud • Analytics • Consulting
The Role
Fine-tune open-source LLMs from experimentation through production on AWS. Run SFT and alignment methods including GRPO and DPO, debug distributed multi-GPU training, resolve loss and memory issues, and collaborate with evaluation and data engineering teams to improve accuracy. Scale models from 8B to 70B parameters based on offline metrics.
Summary Generated by Built In
Job Title:ML / Fine-Tuning Engineer
Location: Hyderabad OR Pune
Notice Period : 0-30 Days
Mode of Work:Hybrid
Experience :5+ Years


We are looking for ML / Fine-Tuning Engineer who can deliver (under supervision of ProServe Tech Lead) the end-to-end fine-tuning of open-source LLMs for a narrow, high-volume production task on AWS — SFT and alignment experiments (GRPO, DPO), debugging training on multi-GPU clusters, and iterating to strict accuracy targets. Models from 8B to 70B parameters.

What We Expect:

  • Fine-tune open-source LLMs (Qwen, Llama) from experiment to production-ready checkpoint
  • Run SFT and RL alignment (GRPO, DPO) to improve output accuracy
  • Execute training on AWS GPU instances (p4d, p5, g5) using distributed training
  • Diagnose/fix training issues: loss imbalances, OOM errors, gradient instabilities
  • Collaborate with evaluation and data engineering to iterate on quality gaps
  • Make data-driven model scaling decisions (8B → 14B → 70B) based on offline metrics


Requirements
  • Experience: 5+ years ML engineering, with 2+ years in LLM fine-tuning
  • LLM Models: Hands-on with open-source LLMs — Qwen and Llama required
  • Training Methods: SFT, LoRA/QLoRA, GRPO, DPO/RLHF
  • Frameworks: NVIDIA NeMo/NeMoRL, VeRL, HuggingFace TRL — must have used at least two
  • Distributed Training: DeepSpeed ZeRO, FSDP2, multi-node GPU orchestration
  • AWS Infrastructure: p4d/p5/g5 GPU instances, SageMaker Training Jobs
  • Languages: Python, PyTorch; CUDA debugging a plus

Preferred (Not Required): Fine-tuning for tool-calling/agent tasks; multi-node GRPO/RLHF with NeMoRL or VeRL; tokenizer internals and chat-template rendering for tool-use formats.



Benefits
  • Comprehensive Medical Coverage:
    Health insurance of INR 5.0 Lakhs for you and your family (up to 6 members), ensuring complete peace of mind.
  • Robust Protection Plans:
    Group Personal Accident Insurance and Group Term Life Insurance to safeguard you and your loved ones.
  • Retirement Benefits:
    PF and Gratuity provided as per standard government regulations.
  • Flexible Work Options:
    Enjoy hybrid work arrangements & flexible working hours.
  • Generous Leave Policy:
    21 days of annual leave, in addition to 10 company-declared holidays.
  • Employee Well-being Spaces:
    Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation.


Skills Required

  • 5+ years of machine learning engineering experience
  • 2+ years of LLM fine-tuning experience
  • Hands-on experience with open-source Qwen and Llama models
  • Experience with SFT, LoRA, QLoRA, GRPO, DPO, and RLHF
  • Experience with at least two of NVIDIA NeMo or NeMoRL, VeRL, and Hugging Face TRL
  • Experience with DeepSpeed ZeRO, FSDP2, and multi-node GPU orchestration
  • Experience using AWS p4d, p5, or g5 GPU instances
  • Experience with SageMaker Training Jobs
  • Proficiency in Python and PyTorch
  • CUDA debugging experience
  • Fine-tuning for tool-calling or agent tasks
  • Multi-node GRPO or RLHF using NeMoRL or VeRL
  • Tokenizer internals and chat-template rendering for tool-use formats
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
414 Employees
Year Founded: 2018

What We Do

DATAECONOMY is a global, cloud-first data and AI consultancy delivering enterprise-grade solutions through an innovative intellectual-property suite. Its work spans data and BI platform modernization, self-service AI, data mesh and fabric, master data management, governance, cloud enablement, digital engineering, knowledge graphs, and machine lakes supporting cybersecurity and financial-crime use cases for enterprise clients.

Similar Jobs

Optum Logo Optum

Full-stack Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Senior Data Analyst

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Technical Product Manager

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Senior Quality Engineer I - ACCELQ Selenium

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Similar Companies Hiring

Northslope Thumbnail
Artificial Intelligence • Information Technology • Software • Analytics • Consulting • Generative AI
London, GB
100 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account