Microsoft Jobs

Software Engineer II - AI Infrastructure

Microsoft

Software Engineer II - AI Infrastructure

Posted 5 Days Ago

Redmond, WA, USA

In-Office

102K-219K Annually

Junior

Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)

The Role

Design, develop, test, deploy, and operate large-scale distributed systems and AI infrastructure services. Build resource management, workload orchestration, capacity management, and control-plane capabilities using C# on Kubernetes and AKS. Troubleshoot production issues, improve scalability and reliability, collaborate cross-functionally, participate in architecture and design reviews, and provide operational support and on-call ownership.

Summary Generated by Built In

Overview

Team Purpose

The future of AI and cloud computing depends on highly reliable, scalable, and efficient distributed systems, and our team is building the platform that powers that future.

As part of the AI Infra team, you will work on large-scale infrastructure that supports some of the world's most demanding cloud services and AI workloads. The infrastructure you will work on powers OpenAI and OSS model hosting, large-scale inferencing, and the backend for Microsoft Copilots — across the largest capacity fleets in the industry. You will help design and build foundational systems that enable reliability, performance, and operational excellence at global scale.

Role Summary

As a Software Engineer II, you will design, develop, and operate distributed systems that power mission-critical cloud services. You will collaborate across engineering disciplines to build resilient, scalable, and highly available platforms, leveraging strong software engineering fundamentals and data-driven decision making. You will contribute throughout the software development lifecycle, from architecture and implementation to deployment, monitoring, and continuous improvement.

This opportunity will allow you to:

- Accelerate your technical and career growth by solving complex distributed systems challenges at cloud scale.

- Develop deep expertise in large-scale infrastructure, reliability engineering, system architecture, and operational excellence.

- Hone your collaboration and leadership skills while working across teams to deliver high-impact solutions that serve millions of users and workloads.

Microsoft Culture

Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day, we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond

Responsibilities

- Design, develop, test, deploy, and operate large-scale distributed systems and platform services that deliver reliable, scalable, secure, and high-performance experiences.

- Build and enhance infrastructure capabilities, resource management services, and workload orchestration solutions that optimize system efficiency, utilization, availability, and performance.

- Develop software and platform features that support capacity management, service scalability, policy-driven decision making, workload placement, prioritization, and operational flexibility across distributed environments.

- Collaborate with engineers, product stakeholders, and cross-functional partners to define technical requirements, influence architecture decisions, and deliver high-quality solutions that address customer and business needs.

- Develop, test, and maintain control plane services written in C#, hosted on Kubernetes (AKS) clusters.  .

- Analyze complex production issues, identify root causes, and implement sustainable solutions that enhance scalability, maintainability, efficiency, and service health. Provide operational support and DRI (on-call) responsibilities for the service. 

- Contribute to engineering best practices through technical design reviews, code quality initiatives, knowledge sharing, mentorship, and a culture of innovation, accountability, inclusion, and continuous learning.

Qualifications

Required Qualifications:

Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.

Preferred Qualifications:

'Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
OOP (Object Oriented Programming) proficiency and practical familiarity with common code design patterns
2+ years of experience with service development in a distributed environment, in a dev-ops role, including concurrency management and stateful resource management
Hands-on experience with public cloud services at the IaaS level

#AIINFRA

Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

Bachelor's degree in Computer Science or a related technical field, or equivalent experience
2+ years of technical engineering experience with coding in languages such as C, C++, C#, Java, JavaScript, or Python
Master's degree in Computer Science or a related technical field and 3+ years of technical engineering experience, or equivalent experience
Bachelor's degree in Computer Science or a related technical field and 5+ years of technical engineering experience, or equivalent experience
Object-oriented programming proficiency and practical familiarity with common code design patterns
2+ years of service development experience in a distributed environment or DevOps role, including concurrency management and stateful resource management
Hands-on experience with public cloud services at the IaaS level

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

Fair & Transparent Compensation — Pay is presented as broadly competitive overall, with clear role/level/location variation and an emphasis on using posted ranges and band information for apples-to-apples comparisons.
Retirement Support — Retirement benefits are described as a standout, highlighted by a strong 401(k) match structure and immediate vesting, plus additional plan features for tax-advantaged saving.
Parental & Family Support — Family-oriented benefits are portrayed as a meaningful strength, with substantial paid parental leave and added supports like back-up care and adoption/surrogacy assistance.

Learn more about Microsoft's Compensation & Benefits →

Microsoft Insights

What's It Like to Work at Microsoft? Microsoft Culture & Values Microsoft Career Growth & Development What's the Work-Life Balance Like at Microsoft? Microsoft Leadership & Management Microsoft Company Growth, Stability & Outlook

View all jobs at Microsoft

View Microsoft Profile

Report Job

Am I A Good Fit?

beta

Get Personalized Job Insights.

Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

HQ: Redmond, WA

206,870 Employees

Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.