The Role
Develop AI accelerator agent software and infrastructure for device configuration, monitoring, lifecycle management, networking, diagnostics, and reliability at cloud scale. The role spans distributed systems, operating systems, device drivers, firmware, hardware enablement, virtualization, and high-performance communication across pre- and post-silicon environments. Responsibilities include building scalable control-plane and device communication, fault recovery, node provisioning, telemetry, and system debugging while collaborating across cloud, hardware, and infrastructure teams.
Summary Generated by Built In
Overview
Responsibilities
Qualifications
#AIINFRA
Microsoft’s AI infrastructure is evolving rapidly to support the next generation of large-scale AI training and inference. The AI Frameworks (AIFx) Networking & Systems Tools (NeST) organisation develops foundational system software that enables Microsoft’s Maia accelerator platforms across pre-silicon development, hardware bring-up, cloud integration and production cloud infrastructure that enables AI accelerators to operate reliably and efficiently at cloud scale.
Within NeST, the India Development Centre is building end-to-end engineering competency across the Maia system software stack. Our work spans the boundary between distributed cloud systems and low-level accelerator software, including control-plane services, host and device management software, accelerator virtualisation, Kubernetes-based infrastructure, Developer/Debugger Infrastructure tools, hardware lifecycle management, reliability, telemetry and diagnostics.
We are looking for a Senior Software Engineer to design and develop AI Accelerator Agent software and infrastructure for managing accelerator devices at cloud scale. You will work across distributed systems, networking, operating systems and device software, spanning both pre-silicon and post-silicon environments, with a focus on high-performance communication, device enablement, reliability and scalability.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
• Design and develop AI Accelerator Agent software for device configuration, monitoring and lifecycle management.
• Build scalable communication between control-plane services, host agents and accelerator devices.
• Develop and optimise networking for high throughput, low latency and resilient distributed communication.
• Enable accelerator software across pre-silicon platforms, including FPGA, emulation, simulation and virtual platforms, through post-silicon hardware.
• Develop device-enablement software integrating with operating systems, drivers, firmware and accelerator hardware.
• Build AI hardware infrastructure capabilities and tools for node provisioning, configuration, health monitoring, diagnostics and lifecycle management.
• Develop robust mechanisms for device health, state management, fault detection and recovery.
• Collaborate across cloud, networking, driver, firmware, hardware and infrastructure teams to deliver end-to-end solutions.
• Apply AI-assisted engineering practices across architecture, design, development, testing, debugging and documentation to improve engineering velocity and software quality.
• Use AI-assisted workflows to accelerate code comprehension, network performance analysis, root-cause investigation, test development and systems debugging.
• Leverage AI to automate repetitive engineering workflows and accelerate diagnosis of complex distributed-system, networking and device-level issues.
• Use AI-assisted learning to deepen expertise across distributed systems, networking, accelerator architecture, drivers, firmware and hardware infrastructure.
• Develop and share reusable AI-assisted engineering practices that improve team productivity, technical learning and domain competency.
Qualifications
Required Qualifications:
• Bachelor’s Degree in Computer Science, Computer Engineering or related technical field, or equivalent experience with 8+ years of industry relevant experience.
• Strong programming skills in C/C++, C#, Rust, Go or similar systems programming languages.
• Experience developing systems software, distributed systems or device-enablement software.
• Strong knowledge of computer networking, network protocols, distributed communication, throughput and latency optimisation.
• Experience enabling software across hardware development or validation environments, including pre-silicon and/or post-silicon platforms.
• Strong understanding of concurrency, asynchronous programming, reliability, state management and failure recovery.
• Strong system-level debugging and problem-solving skills.
• Ability to effectively apply AI-assisted engineering tools and workflows to improve development velocity, debugging, testing and engineering quality.
Preferred Qualifications:
• Experience developing host/device agents or AI accelerator management software.
• Experience with GPU, AI accelerator or heterogeneous compute infrastructure.
• Experience with FPGA, hardware emulation, simulation or virtual platform environments.
• Experience building infrastructure or tooling for compute-node provisioning, health management, diagnostics and device lifecycle management.
• Experience with high-performance networking and large-scale distributed systems.
• Experience with Linux, device drivers, firmware interfaces, PCIe, SR-IOV, PF/VF or device virtualisation.
• Experience with telemetry, profiling, tracing and performance diagnostics.
• Experience applying AI-assisted engineering to code analysis, network/system performance investigations, debugging, testing and engineering automation.
• Experience using AI-enabled workflows to rapidly build technical expertise across complex systems and hardware domains
#AIINFRA
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Skills Required
- Bachelor's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent experience with 8+ years of relevant industry experience.
- Strong programming skills in C/C++, C#, Rust, Go, or similar systems programming languages.
- Experience developing systems software, distributed systems, or device-enablement software.
- Strong knowledge of computer networking, network protocols, distributed communication, throughput, and latency optimization.
- Experience enabling software across hardware development or validation environments, including pre-silicon or post-silicon platforms.
- Strong understanding of concurrency, asynchronous programming, reliability, state management, and failure recovery.
- Strong system-level debugging and problem-solving skills.
- Ability to apply AI-assisted engineering tools and workflows to improve development velocity, debugging, testing, and engineering quality.
- Experience developing host/device agents or AI accelerator management software.
- Experience with GPU, AI accelerator, or heterogeneous compute infrastructure.
- Experience with FPGA, hardware emulation, simulation, or virtual platform environments.
- Experience building infrastructure or tooling for compute-node provisioning, health management, diagnostics, and device lifecycle management.
- Experience with high-performance networking and large-scale distributed systems.
- Experience with Linux, device drivers, firmware interfaces, PCIe, SR-IOV, PF/VF, or device virtualization.
- Experience with telemetry, profiling, tracing, and performance diagnostics.
- Experience applying AI-assisted engineering to code analysis, network or system performance investigations, debugging, testing, and engineering automation.
- Experience using AI-enabled workflows to build technical expertise across complex systems and hardware domains.
Microsoft Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.
-
Healthcare Strength — Health coverage is described as comprehensive, with preventive care coverage, vision options, and annual out-of-pocket limits. Feedback suggests medical, mental-health, and disability support are a major strength of the package.
-
Parental & Family Support — Family support is expansive, including parental leave, family caregiver leave, child-care assistance, family concierge services, fertility options, and college-advising support for eligible employees. Feedback suggests these benefits meaningfully ease caregiving and family planning demands.
-
Wellbeing & Lifestyle Benefits — Wellbeing resources include counseling and employee-assistance services, wellness reimbursements, product discounts, and charitable-matching programs. Feedback suggests these extras complement core benefits and support day-to-day quality of life.
Microsoft Insights
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.
