Software Engineer II - AI Infrastructure

Reposted Yesterday
2 Locations
In-Office
102K-219K Annually
Junior
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
The Role
Designs, builds, debugs, and optimizes scalable AI systems, including inference infrastructure, APIs, distributed services, and platform components. The role delivers secure, reliable, high-performance AI experiences across audio, image, video, and safety applications. Responsibilities include full-stack development, cross-team collaboration, architectural innovation, rapid issue resolution, and end-to-end feature delivery for systems serving millions of customers.
Summary Generated by Built In
Overview
Software engineer role in Cloud + AI team, enabling secure, scalable, and high-performance AI experiences across multimodal verticals, including real-time audio interaction, image generation, video generation and AI safety systems.
 
You will contribute across the full technology stack, from APIs and platform services to the inference infrastructure serving cutting-edge AI models at massive scale. You'll work on systems that power real-world products used by millions of customers while helping advance the reliability, safety, and efficiency of AI platforms.
 
This role is based in either Mountain View, CA or Redmond, WA. We are looking for engineers who thrive in fast-paced environments, enjoy tackling complex technical challenges, and excel in collaborative teams.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.


Responsibilities
  • Implement AI Systems: Design and build scalable, reliable architectures that meet high-performance requirements for AI systems including inference backends and API interfaces. Apply knowledge of distributed systems principles to create robust solutions.
  • Debug and Optimize Across the Stack: dive deep into existing components to identify and resolve issues quickly. Ensure fast turnaround for critical fixes while maintaining system integrity.
  • Collaborate Across Teams and Partners: work closely with multiple internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions.
  • Innovate and Drive Technical Excellence: identify non-obvious technical approaches that unlock new possibilities. Architect and execute features with measurable goals, iterating rapidly to achieve outcomes.
  • Full-Stack Engagement: engage with components across the entire stack—from infrastructure to APIs—to deliver end-to-end solutions.

Qualifications

Required Qualifications: 

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
     

Preferred Qualifications: 

  • Master's Degree in Computer Science or related technical field
    • AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field
    • AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
  • Core technical competencies: distributed systems, scalable architecture, API design, understanding of ML/AI fundamentals and practical applications, experience in delivering AI-based solutions.
  • Familiarity with relevant tools, frameworks, or programming languages: Kubernetes, Azure Devops, Docker, AI / ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, Autogen, Semantic Kernel, LangChain.
  • Optional experience with OpenAI API / Azure OpenAI.
  • Communication and collaboration abilities.
  • Problem-solving and decision-making under ambiguity.
  • Strategic thinking and adaptability.

Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

  • Bachelor's degree in Computer Science or a related technical field and 2+ years of technical engineering experience involving coding
  • Equivalent experience in place of the degree and experience requirement
  • Master's degree in Computer Science or a related technical field and 3+ years of technical engineering experience involving coding
  • Bachelor's degree in Computer Science or a related technical field and 5+ years of technical engineering experience involving coding
  • Experience with distributed systems and scalable architecture
  • Experience with API design
  • Understanding of ML/AI fundamentals and practical applications
  • Experience delivering AI-based solutions
  • Familiarity with Kubernetes, Azure DevOps, Docker, AI/ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, Autogen, Semantic Kernel, or LangChain
  • Optional experience with OpenAI API or Azure OpenAI
  • Communication and collaboration abilities
  • Problem-solving and decision-making under ambiguity
  • Strategic thinking and adaptability

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

  • Healthcare Strength — Health coverage is described as comprehensive, with preventive care coverage, vision options, and annual out-of-pocket limits. Feedback suggests medical, mental-health, and disability support are a major strength of the package.
  • Parental & Family Support — Family support is expansive, including parental leave, family caregiver leave, child-care assistance, family concierge services, fertility options, and college-advising support for eligible employees. Feedback suggests these benefits meaningfully ease caregiving and family planning demands.
  • Wellbeing & Lifestyle Benefits — Wellbeing resources include counseling and employee-assistance services, wellness reimbursements, product discounts, and charitable-matching programs. Feedback suggests these extras complement core benefits and support day-to-day quality of life.

Microsoft Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redmond, WA
206,870 Employees
Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.

Similar Jobs

CDW Logo CDW

Support Engineer

Information Technology
Remote or Hybrid
US
15100 Employees
78K-108K Annually

CDW Logo CDW

Software Engineer

Information Technology
Remote or Hybrid
US
15100 Employees
86K-119K Annually

The Aerospace Corporation Logo The Aerospace Corporation

Honeywell Aerospace Early Career – IT Analyst

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Remote or Hybrid
United States
4600 Employees
80K-109K Annually

Liberty Mutual Insurance Logo Liberty Mutual Insurance

Senior Analyst , Personal Lines Property & Specialty

Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Remote or Hybrid
6 Locations
40000 Employees
83K-176K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account