Core OS is responsible for the foundational technologies that underpin Windows and Windows Server, providing the trusted platform on which customers run their most critical workloads. Our team combines deep systems engineering with modern AI innovation to bring the next generation of intelligent capabilities to enterprise environments.
We are hiring a Senior Software Engineer to build new Artificial Intelligence (AI) platform capabilities for Windows Server across on-premises and hybrid customer deployments. You will be at the forefront of AI inference in a novel environment, and your work will infuse cutting edge AI concepts into existing Server platforms and workflows.
AI has thus far remained in the cloud, and you will translate those cloud-connected ideas to air-gapped, on-premises and hybrid environments. You will work at the intersection of AI models, agents, identity, and management surfaces on our most hardened OS platform. Experience or demonstrated interest in operating system fundamentals is a plus; experience with existing AI inference toolchains is valued.
At Microsoft, our mission—to empower every person and every organization on the planet to achieve more—guides how we partner with customers to deliver trusted, impactful solutions. With a growth mindset culture, we innovate responsibly and measure success by shared progress—people, teams, and customers. Join us to do meaningful work that changes the world and helps shape what’s next for everyone.
Responsibilities
- Design and implement how we track usage, policy and efficiency for artificial intelligence capabilities.
- Build observability pipelines through telemetry insights, diagnostics, and health signals needed to measure how this on-prem infrastructure is performing.
- Define and develop the management layer for AI inference toolchains from model lifecycles and catalogs to language and protocol gateways.
- Design and implement validation plans to assess the quality of this infrastructure and evaluate the end to end workflows and life cycle experiences of such a solution.
- Coordinate with security and compliance teams to ensure this toolchain meets or exceeds platform release requirements.
Qualifications
Required Qualifications
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Preferred Qualifications
- 5+ years of professional software engineering experience with coding in one or more languages such as C, C++, C#, Java, JavaScript, Python, Rust, or TypeScript, including designing automated tests and validation for the software you ship.
- Demonstrated knowledge of Server administration and management features.
- Familiarity with Server deployment and usage strategies in air-gapped or on-premises environments.
- Understanding of AI model catalogs, model servers, protocols and inference layers.
- Familiarity with the current state of the art around observability and diagnostics.
- Experience with systems software development, deep systems architecture, driver development, and code architecture/design for complex software systems.
#W+DJOBS
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Skills Required
- Bachelor's degree in Computer Science or a related technical field
- 4+ years of technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python, or equivalent experience
- 5+ years of professional software engineering experience
- Experience coding in C, C++, C#, Java, JavaScript, Python, Rust, or TypeScript
- Experience designing automated tests and validation for shipped software
- Knowledge of Windows Server administration and management features
- Familiarity with server deployment and usage strategies in air-gapped or on-premises environments
- Understanding of AI model catalogs, model servers, protocols, and inference layers
- Familiarity with observability and diagnostics
- Experience with systems software development, deep systems architecture, driver development, and complex software system design
Microsoft Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.
-
Fair & Transparent Compensation — Pay is presented as broadly competitive overall, with clear role/level/location variation and an emphasis on using posted ranges and band information for apples-to-apples comparisons.
-
Retirement Support — Retirement benefits are described as a standout, highlighted by a strong 401(k) match structure and immediate vesting, plus additional plan features for tax-advantaged saving.
-
Parental & Family Support — Family-oriented benefits are portrayed as a meaningful strength, with substantial paid parental leave and added supports like back-up care and adoption/surrogacy assistance.
Microsoft Insights
What We Do
At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.
