Intellectsoft is a software development company delivering innovative solutions since 2007. We operate across North America, Latin America, the Nordic region, the UK, and Europe. We specialize in industries like Fintech, Healthcare, EdTech, Construction, Hospitality, and more, partnering with startups, mid-sized businesses, and Fortune 500 companies to drive innovation and scalability. Our clients include Jaguar Motors, Universal Pictures, Harley-Davidson, and many more where our teams are making daily impactTogether, our team delivers solutions that make a difference. Learn more at www.intellectsoft.net
Our client is a management consulting and technology firm focused on transforming global healthcare and diverse industries through data-driven strategies, cutting-edge analytics, and advanced AI solutions. This role sits within a focused research initiative dedicated to adapting small language models (SLMs) to specialized, high-value domain applications.
Requirements
- Experience: 3+ years in Machine Learning Engineering or Applied ML, with hands-on experience fine-tuning transformer-based language models.
- Core Tech Stack: Advanced Python and PyTorch proficiency.
- Frameworks & Ecosystem: Deep fluency in the Hugging Face ecosystem, including Transformers, PEFT, Datasets, Accelerate, and TRL.
- Fine-Tuning Expertise: Practical command of SFT with LoRA/QLoRA, alongside the judgment to reason about CPT and RL/preference methods.
- Model Selection: Strong understanding of base model architectures, tokenizer design, pre-training data distributions, licensing, and context window requirements.
- Data Engineering for ML: Proven experience building training pipelines (curation, cleaning, synthetic data generation, and formatting).
- Evaluation & Serving: Ability to design executable correctness evaluations, paired with hands-on experience serving and quantizing models using at least one modern inference framework.
- Research Fluency: Comfort reading recent ML research papers and translating state-of-the-art methods into working code.
Nice to have
- Hands-on experience with Continued Pre-Training (CPT) on large domain corpora.
- Experience with Reinforcement Learning / preference optimization for LLMs (reward modeling, DPO, GRPO, or verifiable-reward setups).
- Experience with structured-output generation, code generation (e.g., SQL/DDL), or domain classification fine-tuning.
- Familiarity with distributed training frameworks (DeepSpeed, FSDP).
- Knowledge distillation experience transferring capabilities from large teacher models to small student models.
- Experience with on-device or edge deployment.
- Active open-source contributions to machine learning tooling, libraries, or published models.
- Own the Model Adaptation Lifecycle: Drive end-to-end adaptation of SLMs to specialized domain tasks, choosing the right base models, training strategies, and architectures.
- Apply Efficient Fine-Tuning: Implement parameter-efficient fine-tuning (PEFT) methods with a mathematically grounded understanding of low-rank adaptation (LoRA, QLoRA, rank selection, parameterization, scaling, and accuracy–efficiency trade-offs).
- Select Strategy per Task: Determine and sequence optimal adaptation strategies - including Continued Pre-Training (CPT), Supervised Fine-Tuning (SFT), and RL/preference tuning (DPO, GRPO, RLHF).
- Curate & Synthesize Data: Clean, curate, format, and generate high-quality datasets, including synthetic data generation when domain data is scarce.
- Design Functional Evaluations: Build task-specific benchmarks grounded in functional, executable correctness rather than loss curves or perplexity alone, maintaining regression tracking across versions.
- Leverage Knowledge Transfer: Use larger models as teachers to transfer capabilities to SLMs via distillation, structured pruning, and quantization.
- Deploy & Optimize Serving: Stand up and optimize inference infrastructure across GPU, CPU, and edge targets using frameworks such as vLLM, TGI, Ollama, llama.cpp, or TensorRT-LLM.
- Pipeline Reproducibility & Research Execution: Break target tasks into milestones with clear criteria, maintaining reproducible pipelines with data/config versioning, checkpointing, and experiment tracking.
- Translate recent literature into reproducible experiments.
Benefits
- Employment-based cooperation
- Comprehensive insurance for you and your family (health, life, and accident)
- Paid PTO policy (vacation, sick leaves, and public holidays)
- Tech equipment provided
- Udemy courses, workshops, trainings & expert knowledge-sharing
- Flexible hours & work setup
Skills Required
- 3+ years of experience in Machine Learning Engineering or Applied Machine Learning
- Advanced Python proficiency
- Advanced PyTorch proficiency
- Deep fluency in Hugging Face Transformers, PEFT, Datasets, Accelerate, and TRL
- Hands-on experience fine-tuning transformer-based language models
- Practical command of supervised fine-tuning with LoRA and QLoRA
- Understanding of continued pre-training and reinforcement learning or preference methods
- Understanding of model architectures, tokenizer design, pre-training data distributions, licensing, and context windows
- Experience building machine learning training pipelines, including data curation, cleaning, synthetic data generation, and formatting
- Ability to design executable correctness evaluations
- Experience serving and quantizing models using a modern inference framework
- Ability to read recent machine learning research papers and implement state-of-the-art methods
- Hands-on experience with continued pre-training on large domain corpora
- Experience with reinforcement learning or preference optimization for large language models
- Experience with structured-output generation, code generation, or domain classification fine-tuning
- Familiarity with DeepSpeed or FSDP
- Knowledge distillation experience
- Experience with on-device or edge deployment
- Open-source contributions to machine learning tooling, libraries, or published models
What We Do
Intellectsoft is a digital transformation consultancy service that provides cutting-edge engineering solutions for global organizations with the mission to help enterprises accelerate the adoption of new technologies, untangle complex issues that always emerge during digital evolution, and orchestrate ongoing innovation. Intellectsoft has been named as one of the highly-rated software development B2B companies in 2021 by Clutch. Ranked No. 244 by Inc. magazine’s annual Inc. 5000 Regionals 2021, Intellectsoft has become one the nation’s fastest-growing private companies and demonstrated solid revenue growth of 37% over the last two years, fueled by customer’s need for innovative software solutions in the era of digitalization. The Company’s services portfolio offers strategic IT consulting, CX design, development, and full lifecycle management of custom software products and applications, and system integration. Whether it is a consumer-oriented app or a transformative enterprise-class solution, the company leads the process from ideation and concept to delivery and provides ongoing support.
