Researcher - LLMs

Reposted One Month Ago
Be an Early Applicant
Montréal, QC, CAN
In-Office
Mid level
Information Technology • Other
The Role
The Researcher will work on projects focused on long-context LLMs, developing training pipelines, collaborating on implementations, and publishing research in prominent conferences.
Summary Generated by Built In

Huawei Canada has an immediate 12-month contract opening for a Researcher.


About the team:

Founded in 2012, the Noah’s Ark lab has evolved into a prominent research organization with notable achievements in academia and industry. The lab’s mission focuses on advancing artificial intelligence and related fields to benefit the company and society. Driven by impactful, long-term projects, the aim is to enhance state-of-the-art research while integrating innovations into the company's products and services, including LLMs, RL, NLP, computer vision, AI theory, and Autonomous driving.

About the job:

  • Participate in applied research projects focused on enabling long-context LLMs, including work on efficient architectures, data curation, and post-training methods

  • Develop and maintain training, post-training, and fine-tuning pipelines, including data preprocessing and evaluation workflows.

  • Collaborate with researchers to translate novel ideas into production-quality implementations.

  • Track advancements in LLM architectures, tooling, and systems, and incorporate relevant developments into engineering workflows.

  • Publish research in top-tier machine learning and natural language processing (NLP) conferences.

About the ideal candidate:

  • A Master’s or Ph.D. in Computer Science, Software Engineering, or a related field, or equivalent practical experience.

  • A deep understanding of NLP and large language model (LLM) fundamentals and state-of-the-art methods, coupled with a strong theoretical grounding in machine learning.

  • Expertise in modern LLM architectures, including transformer models (e.g., Llama, Qwen) and good knowledge in linear-attention models (e.g., GDN, Mamba, GLA).

  • Excellent programming skills in Python, with strong expertise in PyTorch.

  • Experience with LLM training and inference stacks, such as Hugging Face Transformers/Accelerate, Megatron-LM, vLLM, or similar systems.

  • Hands-on experience with distributed training (FSDP,DeepSpeed,DDP) and inference systems for large-scale LLMs is an asset.

  • Experience with diffusion models is an asset.

  • Strong communication skills and the ability to collaborate effectively across engineering and research ideas.

Huawei aims to support a French-speaking work environment for its employees in Quebec. We have taken steps to avoid requiring a language other than French for this position. However, proficiency in English is essential for this role for the following reasons:

The person will be required to communicate regularly with colleagues located outside Quebec, where English is the primary language used for communication between offices. In addition, the nature of the tasks related to this position, which falls within a highly specialized field of artificial intelligence, also requires knowledge of English.

Skills Required

  • Master's or Ph.D. in Computer Science, Software Engineering, or related field
  • Deep understanding of NLP and LLM fundamentals
  • Expertise in modern LLM architectures and linear-attention models
  • Excellent programming skills in Python and expertise in PyTorch
  • Experience with LLM training and inference stacks
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sham Chun Hu
1,770 Employees
Year Founded: 1987

What We Do

Founded in 1987, Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices. We are committed to bringing digital to every person, home and organization for a fully connected, intelligent world. We have approximately 197,000 employees and we operate in over 170 countries and regions, serving more than three billion people around the world. In Canada, Huawei conducts innovative and leading edge research in 5G technologies, along with advanced development of emerging cloud, device and network technologies & services. While our renowned Canada Research Centre in the thriving technology landscape of Ottawa, Ontario continues to grow rapidly in size and strategic product initiatives, additional presence has also been established across Canada with R&D facilities in Vancouver, Edmonton, Waterloo, Markham, Montreal, and a R&D office in Quebec City.

Similar Jobs

In-Office
Montréal, QC, CAN
1770 Employees

Huawei Canada Logo Huawei Canada

Co-op Researcher - LLMs Reasoning

Information Technology • Other
In-Office
Montréal, QC, CAN
1770 Employees
In-Office
Montréal, QC, CAN
1770 Employees

Similar Companies Hiring

Rosendin Thumbnail
Other • Manufacturing
San Jose, CA
6219 Employees
OmniCable Thumbnail
Other
Houston, Texas
815 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account