Senior Software Engineer (Windows ML MLIR Platform)

Reposted Yesterday
Be an Early Applicant
Redmond, WA, USA
In-Office
120K-261K Annually
Senior level
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
The Role
Designs, implements, tests, and supports production compiler and runtime features for the Windows ML MLIR platform. Optimizes machine learning execution across CPU, GPU, and NPU hardware through graph transformations, operator lowering, memory management, scheduling, and performance analysis. Owns complex features through deployment, improves reliability and telemetry, collaborates with Windows and silicon-partner engineers, and guides other engineers in delivering secure, scalable, high-performance platform components.
Summary Generated by Built In
Overview

Help define how AI runs on Windows at global scale. The Windows AI Platform & Tools Team is building the foundational software that turns rapidly advancing models and silicon into fast, efficient, and trusted experiences for millions of customers. Working at the intersection of machine learning compilers, runtimes, operating systems, and heterogeneous hardware, you'll collaborate across Microsoft and with leading silicon partners to solve consequential edge-AI systems challenges.

As a Senior Software Engineer, you will design and deliver core capabilities for the Windows ML MLIR platform across CPU, GPU, and NPU hardware. You will work on production compiler and runtime components that enable developers to deploy machine learning models efficiently and reliably, contributing to graph compilation, hardware-aware optimization, scheduling, memory orchestration, power efficiency, and secure execution. You will own complex features end to end, collaborate across team boundaries, and help turn emerging model and hardware capabilities into durable Windows platform building blocks. The role offers flexible work options, including partial remote work.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.


Responsibilities

Role-based responsibilities

  • Collaborates with and guides appropriate internal (e.g., product manager, privacy/security subject matter expert, technical lead) and external (e.g. customer escalation team, public forums) stakeholders to determine and confirm customer/user requirements for a project/sub-section of a product/solution. Incorporates customer insights into future designs or solution fixes. Ensures unwritten requirements, such as appropriate continuous feedback loops that measure actionable, quantitative (e.g., customer value, usage patterns, solution performance) and qualitative (e.g., accessibility, globalization) indicators of value are incorporated. Understands, provides feedback on, and advocates for security and privacy needs of the customer who will be using the project/sub-section of a product/solution.
  • Identifies dependencies and incorporates them into the development of design documents for a product, application, service or platform. Actively identifies other teams and technologies to leverage, how they interact, and where their own system or team can support others. Understands upstream and downstream interactions between systems and ensures security, compliance, performance, and reliability can be achieved across the entire stack. Collaborates with other teams to reach common goals where dependencies and validation concerns overlap. Works across teams to resolve conflicts around dependency ownership and required work.
  • Leads by example within the team to produce extensible, maintainable, well-tested, secure, and performant code that adheres to design specifications. Continuously improves code performance, testability, maintainability, effectiveness, and cost, while learning about and accounting for relevant trade-offs. Applies metrics to drive code quality and stability. Applies appropriate coding patterns and best practices (e.g., leveraging state-of-the-art generative artificial intelligence [GenAI], approaches to source code organization, naming conventions). Identifies and escalates blockers or unknowns during the development process, communicates how they will impact timelines, and identifies strategies and/or opportunities to address them.
  • Leverages their subject-matter expertise to partner with appropriate stakeholders (e.g., technical program managers) to drive a workgroup's project plans, release plans, and work items. Organizes work into smaller sets of tasks as part of an overall roadmap. Guides other members for project estimation and escalates issues that might cause a delay. Ensures required security protections and detection processes are accounted for in planning. Ensures project plans adhere to security, privacy, and compliance requirements. Ensures all code for a product/solution is properly flighted for quicker mitigation of production incidents. Calculates capacity for planning, accounting for appropriate failover and backup/restore mechanisms for disaster recovery for a project/sub-system of a product. Makes considerations for efficient operation of a project/sub-system of a product after it is live. Establishes a rollback plan for a project/sub-system of a product.
  • Acts as a designated responsible individual (DRI) and guides other engineers by developing and following the playbook, working on-call to monitor a system/product/service for degradation, downtime, or interruptions. Alerts stakeholders as to status and initiates actions to restore system/product/service for simple problems and complex problems when appropriate. Responds within service level agreement (SLA) timeframe. Drives efforts to reduce incident volume, looking globally at incidences and providing broad resolutions. Escalates issues to appropriate owners.
  • Remains current in skills by investing time and effort into being informed of current developments. Proactively seeks new knowledge, evaluating new trends, technical solutions, and patterns, assessing how to adapt them to current problems. Conducts learning and literary sessions to raise awareness on relevant engineering design principles (e.g., security, testability, performance, scalability, accessibility, product knowledge).

 Windows ML MLIR responsibilities

  • Design, implement, test, and support production-quality compiler and runtime features for the Windows ML MLIR platform.
  • Optimize model execution across CPU, GPU, and NPU hardware, including graph transformations, operator lowering, memory use, scheduling, and performance analysis.
  • Own complex features from design through deployment, using telemetry and disciplined engineering practices to improve reliability, diagnosability, and efficiency.
  • Collaborate with Windows, model, runtime, and silicon-partner engineers to integrate new capabilities and resolve end-to-end performance and compatibility issues.

Qualifications

Required/Minimum Qualifications:

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
    • OR equivalent experience.

Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. 

Preferred Qualifications:

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
    • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
    • OR equivalent experience.
  • Experience with MLIR, LLVM, ONNX Runtime, or comparable compiler and runtime technologies.
  • Experience optimizing machine learning workloads for CPU, GPU, NPU, or other heterogeneous hardware.
  • Knowledge of machine learning inference, graph compilation, memory management, and performance analysis.
  • Experience building local model integrations in system- or application-level components.
  • Experience developing and debugging production software in modern C++.
  • Experience with systems software, compilers, runtimes, machine learning infrastructure, or performance-critical platform components.
  • Demonstrated ability to design, implement, test, and operate complex software features across team boundaries.


#W+DJOBS

#AI

#Windows_ML

#Machine_Learning

#Artificial_Intelligence

#Local_Inferencing

#ML


Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

  • Bachelor’s degree in Computer Science or a related technical field and 4+ years of technical engineering experience, including coding in languages such as C, C++, C#, Java, JavaScript, or Python; equivalent experience accepted.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including the Microsoft Cloud Background Check.
  • Master’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience; equivalent experience accepted.
  • Bachelor’s degree in Computer Science or a related technical field and 8+ years of technical engineering experience; equivalent experience accepted.
  • Experience with MLIR, LLVM, ONNX Runtime, or comparable compiler and runtime technologies.
  • Experience optimizing machine learning workloads for CPU, GPU, NPU, or other heterogeneous hardware.
  • Knowledge of machine learning inference, graph compilation, memory management, and performance analysis.
  • Experience building local model integrations in system- or application-level components.
  • Experience developing and debugging production software in modern C++.
  • Experience with systems software, compilers, runtimes, machine learning infrastructure, or performance-critical platform components.
  • Demonstrated ability to design, implement, test, and operate complex software features across team boundaries.

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

  • Fair & Transparent Compensation Pay is presented as broadly competitive overall, with clear role/level/location variation and an emphasis on using posted ranges and band information for apples-to-apples comparisons.
  • Retirement Support Retirement benefits are described as a standout, highlighted by a strong 401(k) match structure and immediate vesting, plus additional plan features for tax-advantaged saving.
  • Parental & Family Support Family-oriented benefits are portrayed as a meaningful strength, with substantial paid parental leave and added supports like back-up care and adoption/surrogacy assistance.

Microsoft Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redmond, WA
206,870 Employees
Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.

Similar Jobs

Optum Logo Optum

Materials Handler

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Arlington, WA, USA
160000 Employees
16-29 Hourly

Optum Logo Optum

Medicaid Specialist

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Seattle, WA, USA
160000 Employees
20-36 Hourly

Optum Logo Optum

Phlebotomist Per Diem

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Seattle, WA, USA
160000 Employees
16-29 Hourly

Optum Logo Optum

Senior Phlebotomist

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Puyallup, WA, USA
160000 Employees
18-32 Hourly

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software • Productivity
US
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account