LLM Algorithm Engineer

Job Summary:

We are looking to add a Large Language Model (LLM) Algorithm Engineer in Changsha, China within our EM Labs team.

It is a great opportunity to work in a tech-driven company. In a relaxed and friendly environment, our headquarters are in the heart of the city, at Runhe Financial Center, full of interesting and challenging projects.

Company Intro:

EveryMatrix is a leading B2B SaaS provider delivering iGaming software, content and services. We provide casino, sports betting, platform and payments, and affiliate management to 200 customers worldwide. The company is profitable, has over EUR 100m in annual revenues, and 1200+ employees in offices across ten countries in Europe, Asia and the US. EveryMatrix was founded in 2008 and remains a founder-owned private company.

What You'll get to do:

• Production Deployment & Optimization of LLM Environments:
• LLM Application Development:

• Design distributed deployment solutions based on NVIDIA hardware architecture (NVLink/NVSwitch). Lead framework selection and performance tuning for vLLM, TensorRT-LLM, SGLang, etc., to achieve high-throughput inference services.
• Build a multi-modal GPU cluster management system to optimize KV Cache storage and loading strategies, improving service efficiency for long-context scenarios.
• Model optimization and engineering deployment.

• Design Prompt Engineering strategies combined with RAG (Retrieval-Augmented Generation) technology to enhance response accuracy in scenarios like intelligent customer service and knowledge-based Q&A. Familiarity with LangChain/AutoGen frameworks is required.
• Lead model fine-tuning (Fine-tuning) using efficient parameter tuning techniques like LoRA/QLoRA to address long-tail issues in vertical domains. Proficiency in PEFT (Parameter-Efficient Fine-Tuning) methods is essential.
• Develop enterprise-grade internal toolchains, including code assistance/generation tools, code review systems, and private knowledge-based systems.
• Design external customer systems, such as smart customer service platforms (integrating speech recognition, ticket management, and compliance auditing). Build multi-Agent collaborative online assistants leveraging multi-Agent task allocation mechanisms.

Requirements:

• Education & Experience:
• Technical Proficiency:
• Preferred Qualifications or Experience with:

• Master’s degree or above in Computer Science, Artificial Intelligence, or related fields.
• 3+ years of professional experience in NLP/LLM projects.

• Proficiency in PyTorch/TensorFlow frameworks, with deep understanding of Transformer architecture and optimization of attention mechanisms.
• Familiarity with CUDA programming and NVLink topology design. Experience in NVIDIA chip operator development (e.g., CUDA kernel optimization) is a plus.
• Mastery of development and deployment frameworks such as LangChain, vLLM, and SGLang, with the ability to independently develop and deploy API services.

• Pre-training or fine-tuning of open-source large models (e.g., LLaMA, DeepSeek).
• Development of intelligent customer service systems (knowledge of IVR, ACD, and call center technologies required).
• Enterprise-level code assistance tools (e.g., code generation, code review systems).
• Construction of knowledge graphs in domains like e-commerce or internet industries.

Here's what we offer:

• Start with 20 days of annual leave, with 2 additional days added each year, up to 30 days by your fifth year with us. Enjoy an additional 13 public holidays and time off for special events, including parental leave, sick leave, bereavement leave, and marriage leave.

Stay Healthy: 10 sick leave days per year, no doctor's note required.

Support for New Parents:

22 weeks of paid maternity leave, with the flexibility to work from home full-time until your child turns 1 year old.

4 weeks of paternity leave, plus the flexibility to work from home full-time until your child is 13 weeks old.

• Our office perks include on-site massages, and frequent team-building activities in various locations.

Benefits & Perks:

• Monthly lunch allowance.
• English courses.
• Onsite gym.
• Access online learning platforms like Udemy for Business and LinkedIn Learning, and a budget for external training.

At EveryMatrix, we're committed to creating a supportive and inclusive workplace where you can thrive both personally and professionally. Come join us and experience the difference!