Principal Applied Scientist

Reposted Yesterday
Be an Early Applicant
Redmond, WA, USA
In-Office
143K-304K Annually
Expert/Leader
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
The Role
Lead applied science for large-scale grounding, search, retrieval, ranking, and agentic AI systems. Develop and optimize models for relevance, source selection, tool use, multi-turn context, factuality, and grounded responses. Design evaluation frameworks and experimentation for retrieval quality, hallucination reduction, task success, latency, cost, and user satisfaction. Partner with engineering, research, product, and design teams to deploy improvements, influence architecture and product direction, and mentor technical teams.
Summary Generated by Built In
Overview

The Microsoft Content team powers AI-driven experiences for more than 1B users across Copilot, Bing, Edge, Windows, and Xbox. We are seeking a Principal Applied Scientist to define and develop the next generation of intelligent, large-scale content platforms.

In this role you will be responsible for modeling, experimentation, product impact, and technical leadership. The ideal candidate will have deep expertise in large language models, information retrieval, ranking, grounding, search systems, and agentic AI. They will work on improving how AI systems retrieve information, reason over context, maintain multi-turn conversations, use tools, rank candidate responses or actions, and produce reliable outputs grounded in trusted data. A hands-on experience tuning and improving models at scale, including techniques such as supervised fine-tuning, preference optimization, model distillation, data curation, evaluation design, and large-scale experimentation will be needed. The individual will be expected to lead complex scientific workstreams, influence product direction, and partner closely with engineering, research, and product teams.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.


Responsibilities
  • Lead applied science for grounding, search, retrieval, and ranking systems that power Microsoft AI and agent experiences across large-scale content surfaces.
  • Develop and improve ranking and reranking models for search results, retrieved passages, source selection, answer candidates, tool choices, and agent actions.
  • Build grounding systems that help AI agents generate reliable, source-backed answers using trusted documents, web content, enterprise data, tool outputs, and user context.
  • Improve end-to-end search and retrieval quality, including query understanding, semantic and hybrid retrieval, freshness, relevance, source quality, personalization, and latency-aware ranking.
  • Advance multi-turn agent experiences by improving context understanding, tool use, task completion, clarification behavior, planning, and recovery from errors.
  • Tune and optimize models for grounded and agentic behavior using methods such as supervised fine-tuning, preference optimization, reward modeling, distillation, synthetic data generation, and scalable experimentation.
  • Define and own evaluation methods and success metrics for ranking quality, retrieval quality, groundedness, factuality, citation correctness, hallucination reduction, task success, user satisfaction, latency, and cost.
  • Partner with engineering, product, research, and design teams to ship science improvements into production, influence architecture, mentor scientists and engineers, and drive high-impact initiatives from ambiguity to measurable product impact.

Qualifications

Required Qualifications:

Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience.

Preferred Qualifications:

  • Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 9+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
    • OR equivalent experience.
  • 10+  industry experience building, evaluating, and deploying machine learning models or AI systems in production.
  • Deep expertise in at least two of the following areas: search, information retrieval, learning-to-rank, recommendation systems, grounded generation, LLM-based ranking, retrieval-augmented generation, conversational AI, or agentic AI systems.
  • Experience with offline and online evaluation, including relevance metrics, A/B experimentation, human evaluation, model diagnostics, and production quality monitoring.
  • Experience working with large-scale datasets, production ML pipelines, distributed training or inference systems, and cross-functional engineering teams.
  • Demonstrated ability to lead ambiguous technical projects as a senior individual contributor and influence product, engineering, and science direction.
  • Communication skills, with the ability to explain scientific tradeoffs clearly to technical and non-technical stakeholders.
  • Experience with production-scale LLM systems, agent frameworks, search engines, ranking systems, or retrieval-augmented generation systems.
  • Experience improving multi-turn AI assistant or agent experiences in real products.
  • Experience with tool-using agents, planning systems, memory, personalization, source ranking, or enterprise search.
  • Experience building evaluation frameworks for factuality, grounding, hallucination, relevance, safety, and task completion.
  • Experience with large-scale experimentation platforms, A/B testing, human evaluation, and model quality monitoring.
  • Experience collaborating with product teams to translate model improvements into measurable customer impact.
  • Experience with publication record, patents, open-source contributions, or demonstrated technical leadership in applied AI, IR, NLP, or ML systems.

#MicrosoftAI 


Applied Sciences IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

  • Bachelor's degree in Statistics, Econometrics, Computer Science, Electrical Engineering, Computer Engineering, or a related field and 6+ years of related experience, or equivalent experience.
  • Master's degree in a related field and 4+ years of related experience, or equivalent experience.
  • Doctorate in a related field and 3+ years of related experience, or equivalent experience.
  • Master's degree in a related field and 9+ years of related experience, or doctorate and 6+ years of related experience, or equivalent experience.
  • 10+ years of industry experience building, evaluating, and deploying machine learning models or AI systems in production.
  • Deep expertise in at least two areas including search, information retrieval, learning-to-rank, recommendation systems, grounded generation, LLM-based ranking, retrieval-augmented generation, conversational AI, or agentic AI systems.
  • Experience with offline and online evaluation, relevance metrics, A/B experimentation, human evaluation, model diagnostics, and production quality monitoring.
  • Experience with large-scale datasets, production machine learning pipelines, distributed training or inference systems, and cross-functional engineering teams.
  • Ability to lead ambiguous technical projects and influence product, engineering, and science direction as a senior individual contributor.
  • Strong communication skills for explaining scientific tradeoffs to technical and non-technical stakeholders.
  • Experience with production-scale LLM systems, agent frameworks, search engines, ranking systems, or retrieval-augmented generation systems.
  • Experience improving multi-turn AI assistant or agent experiences in real products.
  • Experience with tool-using agents, planning systems, memory, personalization, source ranking, or enterprise search.
  • Experience building evaluation frameworks for factuality, grounding, hallucination, relevance, safety, and task completion.
  • Experience with large-scale experimentation platforms, A/B testing, human evaluation, and model quality monitoring.
  • Experience collaborating with product teams to translate model improvements into measurable customer impact.
  • Publication record, patents, open-source contributions, or demonstrated technical leadership in applied AI, information retrieval, natural language processing, or machine learning systems.

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

  • Fair & Transparent Compensation Pay is presented as broadly competitive overall, with clear role/level/location variation and an emphasis on using posted ranges and band information for apples-to-apples comparisons.
  • Retirement Support Retirement benefits are described as a standout, highlighted by a strong 401(k) match structure and immediate vesting, plus additional plan features for tax-advantaged saving.
  • Parental & Family Support Family-oriented benefits are portrayed as a meaningful strength, with substantial paid parental leave and added supports like back-up care and adoption/surrogacy assistance.

Microsoft Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redmond, WA
206,870 Employees
Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.

Similar Jobs

Microsoft Logo Microsoft

Scientist

Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
In-Office
Redmond, WA, USA
206870 Employees
143K-304K Annually

Microsoft Logo Microsoft

Scientist

Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
In-Office
Redmond, WA, USA
206870 Employees
143K-304K Annually

Microsoft Logo Microsoft

Scientist

Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
In-Office
2 Locations
206870 Employees
143K-304K Annually

Microsoft Logo Microsoft

Scientist

Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
In-Office
Redmond, WA, USA
206870 Employees
143K-304K Annually

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account