APIs are the backbone of our connected digital world. The AI Gateway Team is part of the Developer Division at CoreAI which offers a comprehensive solution for managing the full API lifecycle—securing, governing, and controlling AI Tools and we are hiring for a Software Engineer 2 - CoreAI to join our growing team. The platform empowers thousands of developers globally to build and manage Agentic, Web, Mobile, Event-Driven, and IoT applications. It also underpins key Microsoft services like Azure AI Foundry, Consumer Copilot, Logic Apps, Copilot Studio, Power Platform, Bing, and more—enabling rich developer and consumer experiences.
Bringing simplicity to customers, creates challenging engineering opportunities in areas like scalability, high-density, multi-tenancy, high availability, user experience and developer tools.
The rise of generative AI opens new frontiers—join Azure AI Gateway Team to help shape the future of AI developer and application workloads.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day, we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.
Responsibilities
We’re looking for an engineer who is passionate about building new products in a AI-driven world while managing a globally distributed service. The candidate selected will deliver high-quality solutions independently and thrive in a collaborative, diverse team. Versatility, quick learning, and adaptability are essential.
In this role, you’ll design and deliver the next generation of services, features, and developer tools that shape how AI applications are built and operated. You’ll work across open-source and platform components in multiple programming languages. This is a unique opportunity to contribute to large-scale distributed systems and drive initiatives central to Microsoft’s CoreAI strategy.
Key Responsibilities:
- Lead System Design & Architecture: Drive architecture discussions, author design documents, and ensure systems meet security, compliance, and scalability requirements while balancing long-term sustainability with short-term delivery.
- Deliver High-Quality Code: Write extensible, maintainable, and performant code; debug and optimize complex systems; and uphold engineering standards through rigorous code reviews.
- Drive Implementation & Deployment: Lead project planning and experimentation, validate the impact of changes, and ensure safe, reliable deployments across distributed environments.
- Ensure Reliability & Operational Excellence: Maintain live site health, develop incident response playbooks, lead root cause analyses (RCAs), and implement systemic improvements to reduce incident volume and improve SLAs.
- Advance Engineering Tools & Practices: Identify and build developer tools, apply automation in production workflows, and stay current with emerging technologies and industry trends.
- Shape Product Strategy: Influence the product roadmap by aligning technical direction with business goals, leveraging customer feedback, data insights, and competitive analysis.
- Foster Cross-Team Alignment: Collaborate with partner teams to deliver cohesive end-to-end experiences and ensure shared ownership of technical direction.
- Build Core Capabilities: Design and develop foundational platform components and reusable building blocks that accelerate innovation and team velocity.
- Other: Embody our culture and values
Qualifications
- Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- 4+ years of experience designing, building, and operating production-grade software and services at scale, with a proven track record of delivering high-impact solutions.
- Proven experience in designing and building distributed systems and cloud-based services.
- Deep understanding of cloud platforms such as Azure, AWS, or GCP.
- Hands-on experience developing in AI-enhanced environments using tools like GitHub Copilot or similar.
- Hands-on experience with generative AI API platforms such as Azure AI Foundry, OpenAI, Claude, or similar.
- Familiarity with Authorization, Authentication and OAuth standard protocols, lifecycle and specifications is a plus.
- Familiarity with agentic protocols such as MCP or A2A is a plus.
- Verbal and written communication skills, with the ability to clearly articulate complex technical concepts.
Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Skills Required
- Bachelor's degree in Computer Science or a related technical field, or equivalent experience
- 2+ years of technical engineering experience with coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience
- Ability to meet Microsoft, customer, and/or government security screening requirements
- Pass the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter
- Bachelor's degree in Computer Science or related technical field and 4+ years of technical engineering experience, or equivalent experience
- 4+ years designing, building, and operating production-grade software and services at scale
- Experience designing and building distributed systems and cloud-based services
- Deep understanding of Azure, AWS, or GCP
- Hands-on experience developing in AI-enhanced environments using GitHub Copilot or similar tools
- Hands-on experience with generative AI API platforms such as Azure AI Foundry, OpenAI, or Claude
- Familiarity with authorization, authentication, and OAuth protocols
- Familiarity with agentic protocols such as MCP or A2A
- Strong verbal and written communication skills for explaining complex technical concepts
Microsoft Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.
-
Fair & Transparent Compensation — Pay is presented as broadly competitive overall, with clear role/level/location variation and an emphasis on using posted ranges and band information for apples-to-apples comparisons.
-
Retirement Support — Retirement benefits are described as a standout, highlighted by a strong 401(k) match structure and immediate vesting, plus additional plan features for tax-advantaged saving.
-
Parental & Family Support — Family-oriented benefits are portrayed as a meaningful strength, with substantial paid parental leave and added supports like back-up care and adoption/surrogacy assistance.
Microsoft Insights
What We Do
At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.
