Huawei Canada has an immediate permanent opening for a Software Engineer.
About the team:
The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases. This lab addresses various data challenges, including cloud-native disaggregated databases, pay-by-query user models, and optimizing low-level data transfers via RDMA. Teams within this lab create advanced cloud serverless data infrastructure and implement cutting-edge networking technologies for Huawei's global AI infrastructure.
About the job:
Architect and develop frameworks and engines for next-generation serverless computing tailored to AI workloads (LLM training/inference, agent execution, RL training, etc.).
Analyze and optimize end-to-end AI system performance, including distributed scheduling, data flow, and memory utilization across large clusters.
Research and evaluate cutting-edge technologies in distributed computing, serverless infrastructure, reinforcement learning, and LLM-based AI agents.
Collaborate cross-functionally with research, product, and platform teams to transform conceptual AI agent or RL research into scalable production systems.
Contribute thought leadership through innovation, technical presentations, and patent generation.
Stay ahead of industry trends, assessing emerging tools and frameworks (e.g., Ray, SkyPilot, vLLM, DeepSpeed, Mojo, etc.) to inform team.
The total target annual compensation for this position ranges from $127,000 to $225,000 depending on education, experience, and demonstrated expertise.
About the ideal candidate:
PhD with research background in LLM systems, RL, AI agents, or distributed computing, or MS in Computer Science, Electrical Engineering, or related field with 3–4 years of AI industry experience.
Strong system design and software engineering skills, including experience with C++ or Python, concurrency, performance tuning, and large-scale distributed systems.
Proven expertise in one or more of the following areas:
o AI system architecture — LLM training/inference pipeline optimization, multi-agent orchestration, or reinforcement learning frameworks.
o Serverless / distributed infrastructure — autoscaling, resource scheduling, fault recovery, or cloud-native microservices.
Ability to lead complex technical projects, mentor peers, and deliver solutions with measurable impact.
Publications, open-source contributions, or patents in AI systems, RL, or distributed computing is an asset.
Familiarity with GPU cluster management, model parallelism, or memory-optimized inference (e.g., KVCache, offloading strategies) is an asset.
Demonstrated ability to bridge research and engineering, bringing experimental AI methods into production-grade systems is an asset.
Additional Information:
Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.
All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.
Skills Required
- PhD in LLM systems, RL, AI agents, or distributed computing, or MS in related field with industry experience
- Experience with system design, software engineering, C++ or Python, and distributed systems
- Expertise in AI system architecture or serverless infrastructure
- Publications, open-source contributions, or patents in AI systems, RL, or distributed computing
- Familiarity with GPU cluster management and memory-optimized inference
What We Do
Founded in 1987, Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices. We are committed to bringing digital to every person, home and organization for a fully connected, intelligent world. We have approximately 197,000 employees and we operate in over 170 countries and regions, serving more than three billion people around the world. In Canada, Huawei conducts innovative and leading edge research in 5G technologies, along with advanced development of emerging cloud, device and network technologies & services. While our renowned Canada Research Centre in the thriving technology landscape of Ottawa, Ontario continues to grow rapidly in size and strategic product initiatives, additional presence has also been established across Canada with R&D facilities in Vancouver, Edmonton, Waterloo, Markham, Montreal, and a R&D office in Quebec City.
.png)
