Principal Data Scientist - AI Infrastructure

Posted Yesterday
Be an Early Applicant
Hiring Remotely in United States
Remote
143K-331K Annually
Expert/Leader
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
The Role
Lead end-to-end delivery of strategic data science and AI solutions for AI infrastructure. Work with telemetry and experimentation at fleet scale to build, deploy, and measure predictive and prescriptive models. Partner with stakeholders, present insights, enable adoption, and promote responsible AI. Collaborate closely with data engineers and infrastructure teams to productionize scalable ML solutions.
Summary Generated by Built In
Overview
 

As a Principal Data Scientist – AI Infrastructure Data team member, you will own end-to-end delivery of strategic data science projects and partner with customers and internal teams to design and implement advanced analytics and AI solutions that create measurable business impact. This hands on role blends deep technical expertise with consulting and stakeholder engagement, enabling you to influence decisions and guide adoption of data-driven strategies. 

In this role, you will focus on data science for AI infrastructure: turning fleet-scale telemetry, experimentation, and partner requirements into decisions that improve reliability, efficiency, capacity planning, and customer outcomes across Microsoft’s AI systems. 

The AI Infrastructure team builds, operates, and optimizes one of the largest AI fleets in the world. Data Scientists use fleet-scale telemetry, experimentation, and modeling to inform infrastructure planning, systems design, product tradeoffs, and operational decisions. You will work across technical domains and partner organizations to identify the highest-impact opportunities, quantify tradeoffs, and drive action from insight to implementation. 

The AI Infrastructure Data team is full stack owning telemetry collection, data infrastructure, processing, experimentation and measurement for a wide range of partner teams, systems and business processes.  Close collaboration with Data Engineers, Data Infrastructure SWE and SMEs are a day-to-day component of our model.  The team regularly interacts with hyperscale datasets, systems and challenges to deliver impact to Microsoft’s most important initiatives. 

At Microsoft, our mission to empower every person and every organization on the planet to achieve more guides how we partner with customers to deliver trusted, impactful solutions. With a growth mindset culture, we innovate responsibly and measure success by shared progress people, teams, and customers. Join us to do meaningful work that changes the world and helps shape what’s next for everyone. 


Responsibilities

Business Understanding & Impact 

  • Own delivery of complex, high-impact data science and AI solutions for strategic consulting engagements. 

  • Collaborate with stakeholders to define business problems and translate them into actionable AI-driven solutions. 

 
Data Preparation & Modeling 

  • Acquire, clean, and prepare large datasets for modeling. 

  • Build and deploy predictive and prescriptive models using modern machine learning techniques. 

  • Write efficient, maintainable code and ensure scalability for production environments. 

Insight, Communication & Enablement 

  • Present findings to senior stakeholders using compelling storytelling and visualizations. 

  • Simplify complex ML/AI concepts for diverse audiences to drive understanding and adoption. 

Collaboration & Consulting 

  • Act as a trusted advisor to internal teams and customers, ensuring solutions meet business needs. 

  • Promote responsible AI practices, including fairness, transparency, and explainability in model and application development. 

  • Stay current with emerging AI technologies, frameworks, and tools to continuously enhance solution capabilities. 


Qualifications

Required/minimum qualifications: 

  • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)

    • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) 

    • OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 7+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) 

    • OR equivalent experience


Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.


Additional or preferred qualifications: 

  • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 4+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) 

    • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 7+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) 

    • OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 9+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) 

    • OR equivalent experience.  

  • Proven consulting and stakeholder engagement skills with proven ability to influence decisions. 

  • Proficiency in Python and SQL; experience with cloud platforms (Azure preferred). 

  • Knowledge of Responsible AI principles and ethical data practices. 

  • Experience with broader software engineering lifecycle practices, including version control, testing, DevOps, and production deployment of Machine Learning (ML) solutions. 

  • Experience with AI-assisted coding practices and specification-driven development. 


#AIInfra


Data Science IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

Data Science IC6 - The typical base pay range for this role across the U.S. is USD $165,600 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

  • Doctorate in relevant field AND 3+ years data-science experience OR Master's AND 5+ years OR Bachelor's AND 7+ years OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements (Microsoft Cloud Background Check)
  • Proven consulting and stakeholder engagement skills with ability to influence decisions
  • Proficiency in Python and SQL; experience with cloud platforms (Azure preferred)
  • Knowledge of Responsible AI principles and ethical data practices
  • Experience with software engineering lifecycle practices including version control, testing, DevOps, and production deployment of ML solutions
  • Experience with AI-assisted coding practices and specification-driven development
  • Experience managing structured and unstructured data and applying statistical techniques

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

  • Fair & Transparent Compensation Pay is presented as broadly competitive overall, with clear role/level/location variation and an emphasis on using posted ranges and band information for apples-to-apples comparisons.
  • Retirement Support Retirement benefits are described as a standout, highlighted by a strong 401(k) match structure and immediate vesting, plus additional plan features for tax-advantaged saving.
  • Parental & Family Support Family-oriented benefits are portrayed as a meaningful strength, with substantial paid parental leave and added supports like back-up care and adoption/surrogacy assistance.

Microsoft Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redmond, WA
206,870 Employees
Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.

Similar Jobs

Dragos Logo Dragos

Program Manager

Security • Cybersecurity
Remote
United States
295 Employees
182K-182K Annually

Zscaler Logo Zscaler

Account Executive

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Dallas, TX, USA
8697 Employees
120K-170K Annually

Zscaler Logo Zscaler

Principal, AI Research Engineering

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
San Jose, CA, USA
8697 Employees
172K-245K Annually

Zscaler Logo Zscaler

Regional Director, Majors - South

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Location, WV, USA
8697 Employees
1-1 Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account