Senior Engineer-Cloud AI Infrastructure

Posted 4 Days Ago
Be an Early Applicant
Markham, ON, CAN
In-Office
127K-225K Annually
Senior level
Information Technology • Other
The Role
The role involves designing AI infrastructure, optimizing systems for AI workloads, and collaborating with product teams on innovative cloud solutions.
Summary Generated by Built In

Huawei Canada has an immediate permanent opening for a Senior Engineer.

About the team:

Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation center in Canada. The lab focuses on researching and developing advanced cloud technologies, supporting the productization and iterative optimization of its technical achievements. Current research areas include cloud native databases, intelligent SQL engine, AI/Agent infrastructure and LLM/Agent Evaluation Technology. The lab fosters a robust technical environment, allowing collaboration with industry experts to create a highly competitive cloud platform. 

About the job:

  • Join a cutting-edge team building next-generation infrastructure for AI and agentic workloads, sitting at the intersection of research, systems engineering, and product innovation

  • Track and analyze the latest trends in LLMs, agentic AI, and multi-step agent workflows to inform infrastructure direction

  • Investigate and address infrastructure bottlenecks across GPU/NPU utilization, data movement, memory hierarchy, and distributed execution

  • Design system-level architectures for agent execution frameworks, multi-model orchestration, and large-scale inference systems

  • Evaluate AI/agent workload requirements on cloud and hybrid infrastructure, balancing trade-offs across cost, performance, and scalability

  • Deep dive into the full infrastructure stack — from distributed schedulers and inference pipelines to caching and data access patterns

  • Collaborate closely with engineering and product teams to prototype and deliver production-ready solutions grounded in research

  • Translate emerging AI trends and workload patterns into scalable, impactful infrastructure designs

The targeted annual total compensation for this position ranges from $127,000 to $225,000 depending on education, experience, and demonstrated expertise.

About the Ideal Candidate:

  • Solid foundation in distributed systems, cloud infrastructure, or systems engineering, with hands-on experience building or operating large-scale systems

  • Proficiency with Kubernetes, cluster scheduling, or equivalent orchestration platforms in production environments

  • Practical experience with AI/ML systems — whether in training pipelines, inference infrastructure, or both

  • Strong programming skills in low-level or systems-oriented languages such as Go or C++

  • Familiarity with LLM serving frameworks (e.g., vLLM, SGLang, Triton, Ray) and an understanding of how they interact with underlying hardware

  • Experience with GPU or accelerator optimization, and a grasp of how hardware constraints shape system design decisions

  • A research-oriented mindset — comfortable reading papers, running experiments, and prototyping ideas to validate architectural decisions

  • Sharp analytical and problem-solving skills, with the ability to model workloads, identify performance bottlenecks, and propose principled solutions

Additional Information:

Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.

All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Markham, Ontario
1,770 Employees
Year Founded: 1987

What We Do

Founded in 1987, Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices. We are committed to bringing digital to every person, home and organization for a fully connected, intelligent world. We have approximately 197,000 employees and we operate in over 170 countries and regions, serving more than three billion people around the world. In Canada, Huawei conducts innovative and leading edge research in 5G technologies, along with advanced development of emerging cloud, device and network technologies & services. While our renowned Canada Research Centre in the thriving technology landscape of Ottawa, Ontario continues to grow rapidly in size and strategic product initiatives, additional presence has also been established across Canada with R&D facilities in Vancouver, Edmonton, Waterloo, Markham, Montreal, and a R&D office in Quebec City.

Similar Jobs

TransUnion Logo TransUnion

Sr. Director, Solutions Consulting - Canada Credit Risk Solutions

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
2 Locations
13000 Employees
210K-316K Annually

TransUnion Logo TransUnion

Client Experience Specialist (6-month contract)

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Burlington, ON, CAN
13000 Employees
81K-122K Annually

CDW Logo CDW

Senior Software Engineer

Information Technology
Remote or Hybrid
ON, CAN
15100 Employees
102K-141K Annually

Ericsson Logo Ericsson

Designer

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
Ottawa, ON, CAN
88000 Employees
69K-90K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Artificial Intelligence • Other • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account