The Role
Lead NLP and LLM fine-tuning initiatives using PEFT methods, curate and validate training datasets, implement RLHF and DPO alignment, optimize models through quantization, design evaluation benchmarks, manage distributed multi-GPU training, and prepare model checkpoints for cloud deployment. Requires advanced expertise in Python, PyTorch, transformer architectures, CUDA, and NLP, plus a mandatory AWS or Google Cloud machine learning certification.
Summary Generated by Built In
This is a remote position.
NLP Data Scientist / LLM Fine-Tuning Specialist
Job Details
- Employment Type: Contract
- Work Mode: Remote
- Location: Offshore
- Total Experience Required: 4 to 8 years
- Relevant Experience Required: 3+ years of dedicated natural language processing (NLP) and hands-on Large Language Model (LLM) fine-tuning experience
- Mandatory Certification: Google Cloud Certified Professional Machine Learning Engineer or AWS Certified Machine Learning - Specialty
Job Summary
We are seeking an experienced NLP Data Scientist / LLM Fine-Tuning Specialist to take ownership of our specialized open-source model optimization tracks. The ideal candidate will possess deep expertise in deep learning, dataset preparation, and parameter-efficient training methodologies to fine-tune foundational models for industry-specific terminology, domain-specific reasoning, and custom task execution.
Key Responsibilities
- Lead LLM fine-tuning initiatives, leveraging Parameter-Efficient Fine-Tuning techniques (PEFT) including LoRA, QLoRA, Prefix Tuning, and Prompt Tuning to optimize open-source architectures (e.g., Llama, Mistral).
- Curate, clean, and structure high-quality training datasets, implementing automated data deduplication, tokenization schemes, synthetic data generation pipelines, and human-in-the-loop validation frameworks.
- Implement advanced reinforcement learning alignment layers, configuring Reinforcement Learning from Human Feedback (RLHF) or Direct Preference Optimization (DPO) to enforce model safety, helpfulness, and tone guardrails.
- Optimize model footprint constraints and memory overhead, applying post-training quantization techniques (e.g., GGUF, AWQ, GPTQ) to minimize parameter degradation and compute budgets.
- Design rigorous evaluation benchmarks and metrics panels, executing automated validation tests (e.g., BLEU, ROUGE, custom verification matrices) to audit model hallucinations, factual accuracy, and domain alignment.
- Manage distributed deep learning training jobs, scaling pipeline configurations, tensor parallelism parameters, and gradient checkpointing scripts across multi-GPU compute blocks.
- Collaborate with MLOps infrastructure teams, formatting completed model weight checkpoints cleanly for scalable cloud deployment and real-time inference serving layers.
Requirements
- 4 to 8 years of core data science or advanced machine learning engineering experience, with 3+ dedicated years actively training, evaluation, and fine-tuning natural language processing systems.
- Expert-level technical mastery of Python, deep learning frameworks (PyTorch), transformer architectures (Hugging Face Transformers, Accelerate, PEFT), and vector calculations.
- Deep structural understanding of attention mechanisms, tokenization constraints, context window degradation behaviors, loss function optimization, and hardware compute limitations (CUDA).
- Mandatory certification: Professional ML Engineer or Specialty Machine Learning credential from a major cloud vendor (AWS/GCP).
Preferred Qualifications
- Master’s or Ph.D. in Computer Science, Data Science, Computational Linguistics, or an adjacent quantitative field with a research focus on neural network text models.
- Prior experience implementing custom embedding model structures or optimizing domain-specific classification layers inside constrained enterprise runtimes.
Skills Required
- 4 to 8 years of core data science or advanced machine learning engineering experience
- 3+ years of dedicated NLP experience
- 3+ years of hands-on LLM training, evaluation, and fine-tuning experience
- Google Cloud Certified Professional Machine Learning Engineer or AWS Certified Machine Learning Specialty certification
- Expert-level proficiency in Python
- Expert-level proficiency with PyTorch
- Expert-level proficiency with Hugging Face Transformers, Accelerate, and PEFT
- Understanding of attention mechanisms, tokenization, context-window degradation, loss-function optimization, and CUDA hardware limitations
- Master's or Ph.D. in Computer Science, Data Science, Computational Linguistics, or a related quantitative field with neural-network text-model research
- Experience implementing custom embedding models or domain-specific classification layers in constrained enterprise runtimes
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
FyerX is a Bengaluru-based digital marketing agency that helps businesses strengthen their online presence and generate leads and sales. Its services span branding, logo and brand-guideline development, photography and video production, UI/UX design, website development, social media marketing, search engine optimization, email marketing, ecommerce marketing, and digital advertising across platforms such as Google, Facebook, Instagram, and YouTube.
