Principal Software Engineer

Posted 5 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Expert/Leader
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
The Role
Design, develop, test, and support large-scale Azure AI infrastructure services for distributed deep-learning training and inference. Build backend services in C#, Go, Rust, and C++ on Kubernetes, focusing on orchestration, networking, storage, security, scalability, and reliability. Lead architecture, service operations, customer support, and technical direction while collaborating with engineers, data scientists, research teams, and enterprise customers. Mentor team members and help deliver high-quality cloud infrastructure solutions.
Summary Generated by Built In
Overview

Azure AI Infrastructure team is looking for passionate engineers to build the largest deep-learning infrastructure service at Microsoft. In this role you will be tasked with building new components to bring the latest innovations in AI Infrastructure onto the Azure ML platform. You will partner with top engineering talent within Azure AI Infrastructure and across Azure to work on cluster orchestration, job scheduling, storage, networking, containerization and operating system integration. Your work will enable various AI languages and run-times on Azure AI Infrastructure to bring distributed deep learning training and inferencing to life. In addition, you will build infrastructure components required to build, deploy, monitor and service highly available and scalable Microsoft Service Fabric and Kubernetes clusters under your care. You will lead development and customer support from the frontline and establish architecture, service excellence guidelines and a high-quality bar.  

Candidates have a track record for delivering engineering and service excellence on a mid-to-large scale service. 

Who are We? 

We are engineers on Azure AI Infrastructure. We believe that building a planet-scale AI Supercomputer from the ground-up which addresses the fundamental pain-points of data scientists and AI practitioners and takes AI to the unprecedented scale is an opportunity of a lifetime. If you share the same dream as us, come join us! 

 

What Is Azure AI Infrastructure? 

High scale AI workloads are always testing the limits of the infrastructure stack. Large-scale model training and inference with huge data volumes of training data on hundreds-thousands of GPUs make it a true engineering challenge. Azure AI Infrastructure is a globally distributed, multi-tenant service that provides robust, cost-effective AI infrastructure (compute, networking and storage) for AI training and inferencing. By abstracting workloads from underlying infrastructure, Azure AI Infrastructure creates a shared pool of resources that can be dynamically provisioned for full utilization of expensive GPU compute, and enabling data scientists to productively build, scale, experiment, and iterate their models on top of a robust, performant, scalable and cost-effective distributed infrastructure built for AI. In Azure AI Infrastructure, we are constantly seeking to apply the ideas from AI, ML, distributed systems, distributed databases, machine learning, information retrieval, networking, and security.


Responsibilities
  • Work on the architecture, design, and development of the AI Infrastructure services that support large scale AI training and inferencing
  • Develop, test, and maintain backend services written in C#, Go, Rust, C++, hosted on Kubernetes
  • Enhance systems and applications to ensure robustness, efficiency, maintainability, low latency, tight cloud security
  • Provide operational support and DRI responsibilities for the product
  • Develop and foster a deep understanding of the machine learning systems and concepts and their usage by our customers
  • Collaborate closely with engineers, data scientists within the team, internal Microsoft Research teams and external enterprises to build better solutions together
  • Provide vision, expertise, and technical leadership to other team members
  • Help to grow talent in these areas

Qualifications

Required Qualifications 

A master’s or bachelor’s degree in computer science or a related field
10+ years of experience with coding in one of C#, C or C++, Rust, go

Experience working with the Linux operation system, Kubernetes Networking, SDN, and Kubernetes cluster orchestration

Experience with improving service operations or engineering fundamentals

Collaboration skills 

Experience building and shipping production software or services

 

Preferred Qualifications 

Master's Degree or Ph.D. in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.

Experience in development in the Kubernetes ecosystem

Experience working on cloud infrastructure including compute, networking, storage, and identity services 

Experience in working on Kubernetes Networking and Software Defined Networking systems

Experience in building large scale cloud services, distributed systems, or operating systems 


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

  • Bachelor’s or master’s degree in computer science or a related field
  • 10+ years of coding experience in C#, C, C++, Rust, or Go
  • Experience with Linux
  • Experience with Kubernetes networking, software-defined networking, and Kubernetes cluster orchestration
  • Experience improving service operations or engineering fundamentals
  • Collaboration skills
  • Experience building and shipping production software or services
  • Master’s degree or Ph.D. in computer science or a related technical field
  • 8+ years of technical engineering experience coding in languages including C, C++, C#, Java, JavaScript, or Python
  • Experience developing in the Kubernetes ecosystem
  • Experience with cloud infrastructure, including compute, networking, storage, and identity services
  • Experience working on Kubernetes networking and software-defined networking systems
  • Experience building large-scale cloud services, distributed systems, or operating systems

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

  • Healthcare Strength — Medical, dental, and vision coverage is described as comprehensive, with U.S. plans covering preventive care at 100% and limiting annual out-of-pocket costs. Mental-health counseling, employee assistance, and wellbeing resources are also emphasized.
  • Parental & Family Support — Parental leave, family-caregiver leave, childcare assistance, and family concierge services are highlighted as core elements. These supports are presented alongside parenting and family-planning resources.
  • Leave & Time Off Breadth — Vacation, holidays, and flexible work schedules are emphasized, with generous time-away policies noted. Leave options extend beyond standard vacation to include caregiver and parental programs.

Microsoft Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redmond, WA
206,870 Employees
Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.

Similar Jobs

Atlassian Logo Atlassian

Principal Software Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
560071, Domlur, Karnataka, IND
11000 Employees

Atlassian Logo Atlassian

Principal Software Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
560071, Domlur, Karnataka, IND
11000 Employees

Atlassian Logo Atlassian

Principal Software Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
560071, Domlur, Karnataka, IND
11000 Employees

Toast Logo Toast

Principal Software Engineer

Cloud • Fintech • Food • Information Technology • Software • Hospitality
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
5000 Employees

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account