End-to-End Inference Optimization: Lead the optimization of the full inference pipeline for Large Models (LLM, Multimodal); focus on KV Cache storage strategies, Router architecture design, and collaborative operator optimization to maximize throughput and minimize latency.
Heterogeneous Computing Research: Conduct in-depth research into the underlying inference logic of various hardware accelerators; evaluate architectural suitability for real-time, batch, and streaming inference scenarios to develop standardized optimization schemes.
Inference Framework & Toolchain: Design and implement high-performance inference frameworks; optimize scheduling and memory management to resolve long-tail issues such as communication latency and load imbalance in distributed inference.
Technological Innovation: Track global advancements in inference technology (e.g., compiler optimization, model compression, and hardware fusion); drive the productization of emerging technologies within production environments.
Technical Leadership: Lead efforts to overcome key technical bottlenecks in inference optimization; design technical roadmaps and mentor team members to build a robust AI inference technical ecosystem.
Education & Experience: Master’s or Ph.D. in Computer Science, Electronic Engineering, AI, or related fields; significant professional experience in AI inference optimization or heterogeneous computing.
Hardware Expertise: Proficient in at least one AI accelerator architecture; deep understanding of underlying principles, instruction sets, and hardware-specific tuning.
Inference Specialization: Mastery of core inference optimization techniques, including multi-level KV Cache management, Quantization, and Intelligent Routing.
Systems Proficiency: Expert in parallel computing and distributed systems; deep understanding of low-level programming models (e.g., CUDA, Triton) and inference engine architectures.
Frameworks & Models: Familiar with mainstream deep learning frameworks (e.g., PyTorch, TensorFlow); experience in optimizing ultra-large-scale models is highly preferred.
Industry Insight: Stay current with global evolutions in inference technology and computing architectures, with the ability to objectively evaluate different technical paths.
Professional Skills: Strong analytical and cross-team collaboration skills, with a proven track record of leading complex inference projects to fruition.
Preferred Qualifications: Experience in tuning ultra-large-scale inference clusters or driving AI inference productization; high-level publications or core patents in relevant fields are a plus.
Location State(s)
US-California-Palo AltoThe expected base pay range for this position in the location(s) listed above is $124,800.00 to $235,000.00 per year. Actual pay may vary depending on job-related knowledge, skills, and experience. Employees hired for this position may be eligible for a sign on payment, relocation package, and restricted stock units, which will be evaluated on a case-by-case basis. Subject to the terms and conditions of the plans in effect, hired applicants are also eligible for medical, dental, vision, life and disability benefits, and participation in the Company’s 401(k) plan. The Employee is also eligible for up to 15 to 25 days of vacation per year (depending on the employee’s tenure), up to 13 days of holidays throughout the calendar year, and up to 10 days of paid sick leave per year. Your benefits may be adjusted to reflect your location, employment status, duration of employment with the company, and position level. Benefits may also be pro-rated for those who start working during the calendar year.Equal Employment Opportunity at TencentAs an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.
Skills Required
- Master's or Ph.D. in Computer Science, Electronic Engineering, AI, or related fields
- Significant professional experience in AI inference optimization or heterogeneous computing
- Proficient in at least one AI accelerator architecture
- Deep understanding of multi-level KV Cache management, Quantization, and Intelligent Routing
- Expert in parallel computing and distributed systems; knowledge of low-level programming models
- Familiar with mainstream deep learning frameworks such as PyTorch and TensorFlow
- Experience in optimizing ultra-large-scale models
Tencent Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Tencent and has not been reviewed or approved by Tencent.
-
Healthcare Strength — Healthcare coverage is positioned as a standout, with strong PPO options and relatively low prescription costs highlighted for U.S. plans. This suggests the medical offering can be a meaningful component of the overall rewards package for U.S.-based employees.
-
Retirement Support — Retirement support is framed as competitive in the U.S., with employer match details called out as an item to confirm in writing. This indicates retirement benefits can be a notable strength where applicable.
-
Strong & Reliable Incentives — Performance-linked incentives and share-based awards are repeatedly included as part of the compensation model, alongside potential RSU and sign-on eligibility in certain roles. This points to total rewards often extending beyond base pay through variable and equity components.
Tencent Insights
What We Do
Tencent uses technology to enrich the lives of Internet users. Our communications and social platforms Weixin and QQ connect users with each other, with digital content and daily life services in just a few clicks. Our high performance advertising platform helps brands and marketers reach out to hundreds of millions of consumers in China. Our financial technology and business services support our partners' business growth and assist their digital upgrade. We invest heavily in talent and technological innovation, actively participating in the development of the Internet industry. Tencent was founded in Shenzhen, China, in 1998, and listed on the Main Board of the Stock Exchange of Hong Kong since June 2004.
.jpeg)
