Principal AI Silicon Architect

Sorry, this job was removed at 03:08 p.m. (UTC) on Tuesday, Jul 28, 2026
Be an Early Applicant
3 Locations
In-Office
143K-304K Annually
Expert/Leader
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
The Role
Lead AI silicon architecture direction: define specifications and develop functional/analytical models for AI core compute. Collaborate with software and hardware teams, and guide design, DV, emulation, firmware, and kernel teams through end-to-end silicon development and validation.
Summary Generated by Built In
Overview

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft’s expanding Cloud Infrastructure and responsible for powering Microsoft’s “Intelligent Cloud” mission. SCHIE delivers the core infrastructure and foundational technologies for Microsoft's over 200 online businesses including Bing, MSN, Office 365, Xbox Live, Teams, OneDrive, and the Microsoft Azure platform globally with our server and data center infrastructure, security and compliance, operations, globalization, and manageability solutions. Our focus is on smart growth, high efficiency, and delivering a trusted experience to customers and partners worldwide and we are looking for passionate engineers to help achieve that mission. 

As Microsoft's cloud business continues to grow the ability to deploy new offerings and hardware infrastructure on time, in high volume with high quality and lowest cost is of paramount importance. To achieve this goal, the AI Silicon Architecture team is instrumental in defining and delivering operational measures of success for hardware manufacturing, improving the planning process, quality, delivery, scale and sustainability related to Microsoft cloud hardware. We are looking for an engineer with a dedicated passion for customer focused solutions, insight and industry knowledge to envision and implement future technical solutions that will manage and optimize the Cloud infrastructure. 

We are looking for a Principal AI Silicon Architect to join the team. 


Responsibilities
  • Drive High-Performance AI Silicon Architecture direction  
  • Develop Silicon Architecture Specifications for AI Core Compute 
  • Develop functional and analytical models of silicon IP blocks  
  • Collaborate with AI Software and Hardware teams to drive the optimum silicon architecture for current and future AI Models 
  • Support and guide Design, DV, Emulation, Firmware, and Kernel development teams through End-to-End Silicon development cycle  


Qualifications

Required/minimum qualifications

  • Doctorate in Electrical Engineering, Computer Engineering, Computer Science, or related field AND 3+ years technical engineering experience OR Master's Degree in Electrical Engineering, Computer Engineering, Computer Science, or related field AND 6+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Computer Science, or related field AND 8+ years technical engineering experience OR equivalent experience.

Other Requirements 

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. 
  • This role will require access to information that is controlled for export under export control regulations, potentially under the U.S. International Traffic in Arms Regulations or Export Administration Regulations, the EU Dual Use Regulation, and/or other export control regulations.  As a condition of employment, the successful candidate will be requiredto provide either proof of their country of citizenship or proof of their US. residency or other protected status(e.g., under 8 U.S.C. 1324b(a)(3)) for assessment of eligibility to access the export-controlled information.To meet this legal requirement, and as a condition of employment, the successful candidate’s citizenship will be verified with a valid passport. Lawful permanent residents, refugees, and asylees may verify status using other documents, where applicable.  

Preferred Qualifications: 
 

  • 3+ years of Silicon Architecture experience 
  • 1+ End-to-end Silicon Project experience with successful tape out, bring up, and validation 
  • Deep understanding of current and emerging machine learning models and workloads for both training and inference 
  • Clearly demonstrates knowledge and expertise in large matrix multiplication, data formats / numeric representations, parallel computing, etc., as related to machine learning applications 
  • 3+ years of AI Silicon Architecture experience including Tensor and Vector processing architecture 
  • 1+ End-to-end AI Silicon Project experience as Lead Architect for IP block carried all the way from incubation through silicon bring up and validation. 
  • Skilled in C/C++  
  • Skilled in Verilog/System Verilog 
  • 2+ years of bit-accurate C-model development experience 
  • 2+ years of RTL design experience 


Silicon Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

  • Doctorate in EE/CE/CS + 3+ years OR Master's in EE/CE/CS + 6+ years OR Bachelor's in EE/CE/CS + 8+ years (or equivalent experience)
  • Ability to meet Microsoft, customer and/or government security screening (Microsoft Cloud background check) and pass periodic rechecks
  • Willingness/ability to provide proof of citizenship or US residency (passport or equivalent) for export-controlled information access
  • 3+ years of Silicon Architecture experience
  • 1+ end-to-end silicon project experience with successful tape out, bring up, and validation
  • Deep understanding of current and emerging machine learning models and workloads (training and inference)
  • Expertise in large matrix multiplication, numeric data formats, and parallel computing for ML
  • 3+ years AI silicon architecture experience including Tensor and Vector processing architecture
  • 1+ end-to-end AI silicon project experience as Lead Architect from incubation through bring up and validation
  • Skilled in C/C++
  • Skilled in Verilog/SystemVerilog
  • 2+ years of bit-accurate C-model development experience
  • 2+ years of RTL design experience

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

  • Fair & Transparent Compensation Pay is presented as broadly competitive overall, with clear role/level/location variation and an emphasis on using posted ranges and band information for apples-to-apples comparisons.
  • Retirement Support Retirement benefits are described as a standout, highlighted by a strong 401(k) match structure and immediate vesting, plus additional plan features for tax-advantaged saving.
  • Parental & Family Support Family-oriented benefits are portrayed as a meaningful strength, with substantial paid parental leave and added supports like back-up care and adoption/surrogacy assistance.

Microsoft Insights

Similar Jobs

Shield AI Logo Shield AI

Senior Manager, Customer Success (R5273)

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
In-Office
Dallas, TX, USA
144K-216K Annually

TransUnion Logo TransUnion

Vice President Media & Entertainment Sales

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Remote or Hybrid
14 Locations
13000 Employees
134K-296K Annually

Samsara Logo Samsara

Customer Success Manager

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
66K-88K Annually

Sprinter Health Logo Sprinter Health

Clinical Manager - (remote - travel required)

Artificial Intelligence • Healthtech • Logistics • Social Impact • Software • Telehealth
Remote or Hybrid
2 Locations
500 Employees
125K-140K Hourly
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redmond, WA
206,870 Employees
Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account