Cloud Principal Hardware Engineer

Posted 18 Hours Ago
Be an Early Applicant
3 Locations
In-Office
143K-304K Annually
Expert/Leader
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
The Role
Leads hardware failure analysis and resiliency for Azure’s global server fleet. Defines telemetry signals, diagnostics, detection rules, repair procedures, and validation targets; partners with software engineers, data scientists, component teams, and suppliers on root-cause analysis and corrective actions. Handles senior live-site hardware escalations, prepares new server and AI/GPU platforms for production, applies AI and machine learning to automate analysis, improves fleet availability, and mentors engineers.
Summary Generated by Built In
Overview

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft’s expanding Cloud Infrastructure and responsible for powering Microsoft’s “Intelligent Cloud” mission. SCHIE delivers the core infrastructure and foundational technologies for Microsoft’s over 200 online businesses including Bing, MSN, Office 365, Xbox Live, Teams, OneDrive, and the Microsoft Azure platform globally with our server and data center infrastructure, security and compliance, operations, globalization, and manageability solutions. Our focus is on smart growth, high efficiency, and delivering a trusted experience to customers and partners worldwide and we are looking for passionate engineers to help achieve that mission. 

As Microsoft’s cloud business continues to grow, the ability to deploy new offerings and HW infrastructure on time, in high volume, with high quality and lowest cost is of paramount importance. To achieve this goal, the SCHIE team is instrumental in defining and delivering measures of success for hardware design, qualification, fleet support, scale, and sustainability related to Microsoft cloud hardware. 

Azure Memory and Storage Center of Excellence (AMS CoE) is part of the SCHIE organization focusing on memory and storage devices going into the cloud hardware servers. AMS provides memory and storage solutions to Azure and drives memory and storage suppliers to deliver high quality products that meet our requirements. AMS CoE also leads Azure Fault Prediction and Detection (AFPD), the platform that predicts, detects and repairs hardware failures across the Azure fleet. 

We are looking for a Cloud Principal Hardware Engineer to scale AFPD across hardware components in the Azure fleet and to lead hands-on hardware resiliency for the platform. 

The opportunity: 

Every hour a server sits unhealthy is an hour of lost customer capacity. AFPD turns hardware, firmware and OS telemetry into early detection and prediction of failures, moves customer workloads off failing nodes, and sends a targeted repair for the part that failed. Repair outcomes and supplier failure analysis then improve the next rule or model. 

You will be working on incorporating into the platform components such as storage, memory, power supply, CPU, GPU, NIC, HBA/FPGA, cables and the rest of the server, and you will be the subject matter expert the team relies on when a failure needs to be prevented. Across millions of nodes, each improvement means fewer VM interruptions for customers and faster return of online capacity. 

Why this role:

Your impact shows up in fleet availability and customer uptime, quarter over quarter. You will set the hardware direction for a platform that influences production infrastructure at a scale, and you will work directly with Azure engineering, component teams and leading hardware suppliers. 

#SCHIE #azurehwjobs 


Responsibilities
  • Lead failure analysis across server components: characterize failure modes from fleet telemetry and logs and confirm root cause with repair results and supplier failure analysis. 

  • Define the signals, thresholds, targeted diagnostics and repair recipes, and work with component teams for the root cause analysis. 

  • Improve isolation accuracy so each repair address the source of failures: improve efficacy of the detection and repair services. 

  • Partner with software engineers and data scientists on detection rules and prediction models; set precision targets and validation gates before a rule or model takes action on production nodes. 

  • Use AI agents and machine learning to automate failure analysis, live-site triage and supplier RCA follow-up, and to shorten the time from a new failure signature to a detection rule. 

  • Lead root cause and corrective actions with server components, including firmware fixes, and feed the learnings back into the platform. 

  • Lead as the senior hardware escalation point for live-site incidents, from triage through root cause to fleet-wide mitigation. 

  • Make new server generations and AI/GPU platforms platform-ready before they reach production, with detection, isolation and repair coverage at launch. 

  • Track and improve metrics & mentor engineers across the team. 


Qualifications

Required Qualifications

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Other Requirements:

    • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
    • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.  

Preferred Quilifications: 

  • Master’s Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience 

  • OR Bachelor’s Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience 

  • OR equivalent experience 

  • 6+ years of hands-on failure analysis, debug or reliability engineering for server or datacenter hardware, covering two or more server component types 

  • 3+ years leading root cause analysis and corrective actions with hardware suppliers, OEMs or ODMs 

  • 2+ years using AI or machine learning in hardware engineering work, such as failure analysis, telemetry analysis or automation 

  • 10+ years in server hardware reliability, failure analysis or fleet resiliency at cloud or datacenter scale 

  • Technical depth in the failure modes of at least one server component type, with working knowledge across the rest of the server (BMC, PCIe, firmware) 

  • Experience turning failure signatures into automated detection rules, fault codes or repair procedures for a large fleet 

  • Experience with predictive maintenance or anomaly detection on hardware telemetry, including setting precision targets and automated repair actions 

  • Proficiency with Kusto (Azure Data Explorer) or SQL, and Python or PowerShell, for large-scale telemetry analysis 

  • Experience with NPI and hardware qualification for server platforms 



Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

  • Bachelor's degree in Computer Science or a related technical field, plus 6 or more years of technical engineering experience with coding in languages such as C, C++, C#, Java, JavaScript, or Python; equivalent experience accepted.
  • Ability to meet Microsoft, customer, and/or government security screening requirements.
  • Pass the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.
  • Master's degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or a related field, plus 7 or more years of technical engineering experience; equivalent experience accepted.
  • Bachelor's degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or a related field, plus 8 or more years of technical engineering experience; equivalent experience accepted.
  • 6 or more years of hands-on failure analysis, debugging, or reliability engineering for server or datacenter hardware across at least two component types.
  • 3 or more years leading root-cause analysis and corrective actions with hardware suppliers, OEMs, or ODMs.
  • 2 or more years using artificial intelligence or machine learning in hardware engineering work.
  • 10 or more years in server hardware reliability, failure analysis, or fleet resiliency at cloud or datacenter scale.
  • Technical depth in failure modes of at least one server component type, with working knowledge of BMC, PCIe, and firmware.
  • Experience converting failure signatures into automated detection rules, fault codes, or repair procedures for large fleets.
  • Experience with predictive maintenance or anomaly detection on hardware telemetry, including precision targets and automated repair actions.
  • Proficiency with Kusto or Azure Data Explorer, SQL, and Python or PowerShell for large-scale telemetry analysis.
  • Experience with new product introduction and hardware qualification for server platforms.

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

  • Healthcare Strength — Medical, dental, and vision coverage is described as comprehensive, with U.S. plans covering preventive care at 100% and limiting annual out-of-pocket costs. Mental-health counseling, employee assistance, and wellbeing resources are also emphasized.
  • Parental & Family Support — Parental leave, family-caregiver leave, childcare assistance, and family concierge services are highlighted as core elements. These supports are presented alongside parenting and family-planning resources.
  • Leave & Time Off Breadth — Vacation, holidays, and flexible work schedules are emphasized, with generous time-away policies noted. Leave options extend beyond standard vacation to include caregiver and parental programs.

Microsoft Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redmond, WA
206,870 Employees
Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.

Similar Jobs

Chewy Logo Chewy

Clinic Business Associate

eCommerce • Pet • Retail • Pharmaceutical
Hybrid
Bellevue, WA, USA
17800 Employees
66K-98K Annually

Zscaler Logo Zscaler

Senior Technical Marketing Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
USA
8697 Employees
144K-205K Annually

Cleo Logo Cleo

Product Marketing Manager

Cloud • eCommerce • Information Technology • Professional Services • Software
Remote or Hybrid
USA
500 Employees
120K-135K Annually

Cleo Logo Cleo

Director, Channel Sales

Cloud • eCommerce • Information Technology • Professional Services • Software
Remote or Hybrid
USA
500 Employees
115K-125K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account