Senior Software Engineer, AI Infrastructure

Reposted Yesterday
Be an Early Applicant
Redmond, WA, USA
In-Office
120K-261K Annually
Senior level
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
The Role
Design, build, and operate globally distributed AI infrastructure that routes requests, prioritizes traffic, and allocates GPU capacity. Develop reliable, secure, and scalable services; collaborate with product and partner teams to launch AI capabilities; support production systems through monitoring, on-call rotations, troubleshooting, and gradual rollouts. Mentor engineers, conduct code reviews, and apply AI tools throughout the software development lifecycle.
Summary Generated by Built In
Overview
Every time someone uses Azure OpenAI Service, their request needs to reach the right graphics processing unit (GPU), in the right region, at the right moment. Our team makes that happen. We build the platform that decides how AI traffic flows across Microsoft's global infrastructure, so services like Azure OpenAI and Microsoft Copilot stay fast and reliable. You'll join a supportive, connected team that keeps these experiences fair and dependable for every customer while making the most of every GPU we run.
 
As a Senior Software Engineer, AI Infrastructure on our team, you'll design, build, and run services that route and prioritize AI requests and match them to available computing capacity. You'll own the design of key parts of our platform, work with partner teams to bring new AI models and capabilities to customers, and help keep our services healthy in production. This opportunity will allow you to deepen your knowledge of distributed systems at global scale, learn how the world's leading AI models are served, and grow as a technical leader and mentor on your team.
 
Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities
  • Design - Own the design of key parts of our platform for routing AI traffic and managing computing capacity. Write design proposals, compare options, and make sure designs meet goals for speed, reliability, scale, and cost.
  • Coding - Write clear, secure, well-tested code and set a good example for the team. Give thoughtful, timely code reviews that help others grow.
  • Implement - Break work into clear, dependable milestones with program managers. Use feature flags and gradual rollouts to test changes safely, measure their impact, and roll back quickly when needed.
  • Reliability and Supportability - Take part in the on-call rotation as a designated responsible individual (DRI). Add monitoring and dashboards, improve troubleshooting guides, and help reduce how often incidents happen.
  • Understand User Requirements - Work with product managers and partner teams to understand what customers need and turn those needs into clear technical requirements.
  • Engineering Excellence - Build security, privacy, and compliance into every stage of your work, from design to deployment. Automate testing and releases, and share what you learn with the team.
  • AI-Native Development - Use artificial intelligence (AI) tools across the software development lifecycle (SDLC), from writing code and tests to investigating live issues. Take responsibility for AI-generated work and help teammates do the same.
  • Embody our Culture and Values 


Qualifications

Required Qualifications: 

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
    • OR equivalent experience. 
Other Requirements
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
    • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter. 
Preferred Qualifications
  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
    • OR Bachelor's Degree in Computer Science or related technical field
      • AND 8+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
    • OR equivalent experience.
  • 3+ years of experience running distributed services on public cloud platforms such as Microsoft Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP).
  • 2+ years of experience with systems that route or schedule traffic, or that allocate computing resources.
  • Experience with Python, Docker, and Kubernetes.
  • Experience with AI or machine learning (ML) infrastructure, such as serving models in production or managing GPU fleets.
  • Experience delivering projects with partner teams, from design through launch and operation.
  • Experience being on call for highly available services and improving monitoring to reduce incidents.

#AIINFRA


Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

  • Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience building distributed systems with C#, Java, Go, or equivalent experience
  • Ability to pass Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check
  • Master's degree in Computer Science or a related technical field and 6+ years of technical engineering experience building distributed systems with C#, Java, Go, or equivalent experience
  • Bachelor's degree in Computer Science or a related technical field and 8+ years of technical engineering experience building distributed systems with C#, Java, Go, or equivalent experience
  • 3+ years of experience running distributed services on public cloud platforms such as Microsoft Azure, AWS, or GCP
  • 2+ years of experience with systems that route or schedule traffic or allocate computing resources
  • Experience with Python, Docker, and Kubernetes
  • Experience with AI or machine learning infrastructure, including production model serving or GPU fleet management
  • Experience delivering projects with partner teams from design through launch and operation
  • Experience being on call for highly available services and improving monitoring to reduce incidents

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

  • Healthcare Strength — Health coverage is described as comprehensive, with preventive care coverage, vision options, and annual out-of-pocket limits. Feedback suggests medical, mental-health, and disability support are a major strength of the package.
  • Parental & Family Support — Family support is expansive, including parental leave, family caregiver leave, child-care assistance, family concierge services, fertility options, and college-advising support for eligible employees. Feedback suggests these benefits meaningfully ease caregiving and family planning demands.
  • Wellbeing & Lifestyle Benefits — Wellbeing resources include counseling and employee-assistance services, wellness reimbursements, product discounts, and charitable-matching programs. Feedback suggests these extras complement core benefits and support day-to-day quality of life.

Microsoft Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redmond, WA
206,870 Employees
Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.

Similar Jobs

Microsoft Logo Microsoft

Senior Software Engineer

Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
In-Office
2 Locations
206870 Employees
120K-261K Annually

Airwallex Logo Airwallex

Senior Software Engineer

Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Hybrid
Seattle, WA, USA
2700 Employees
150K-245K Annually
In-Office
Redmond, WA, USA
8879 Employees
165K-270K Annually

NVIDIA Logo NVIDIA

Software Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office or Remote
5 Locations
21960 Employees
184K-357K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account