APIs are the backbone of our connected digital world. The AI Gateway Team is hiring a Senior Software Engineer - CoreAI as a part of the Developer Division at CoreAI; offering a comprehensive solution for managing the full API lifecycle—securing, governing, and controlling AI Tools. The platform empowers thousands of developers globally to build and manage Agentic, Web, Mobile, Event-Driven, and IoT applications. It also underpins key Microsoft services like Azure AI Foundry, Consumer Copilot, Logic Apps, Copilot Studio, Power Platform, Bing, and more—enabling rich developer and consumer experiences.
Bringing simplicity to customers creates challenging engineering opportunities in areas like scalability, high-density, multi-tenancy, high availability, user experience, and developer tools.
The rise of generative AI opens new frontiers—join the AI Gateway Team to help shape the future of AI developer and application workloads.
Responsibilities
We’re looking for an engineer who is passionate about building new products in a fast-paced AI-driven world while managing a globally distributed service. The ideal candidate delivers high-quality solutions independently and thrives in a collaborative, diverse team. Versatility, quick learning, and adaptability are essential.
In this role, you’ll design and deliver the next generation of services, features, and developer tools that shape how AI applications are built and operated. You’ll work across open-source and platform components in multiple programming languages. This is a unique opportunity to contribute to large-scale distributed systems and drive initiatives central to Microsoft’s Core AI strategy.
Key Responsibilities:
- Lead System Design & Architecture: Drive architecture discussions, author design documents, and ensure systems meet security, compliance, and scalability requirements while balancing long-term sustainability with short-term delivery.
- Deliver High-Quality Code: Write extensible, maintainable, and performant code; debug and optimize complex systems; and uphold engineering standards through rigorous code reviews.
- Drive Implementation & Deployment: Lead project planning and experimentation, validate the impact of changes, and ensure safe, reliable deployments across distributed environments.
- Ensure Reliability & Operational Excellence: Maintain live site health, develop incident response playbooks, lead root cause analyses (RCAs), and implement systemic improvements to reduce incident volume and improve SLAs.
- Advance Engineering Tools & Practices: Identify and build developer tools, apply automation in production workflows, and stay current with emerging technologies and industry trends.
- Shape Product Strategy: Influence the product roadmap by aligning technical direction with business goals, leveraging customer feedback, data insights, and competitive analysis.
- Foster Cross-Team Alignment: Collaborate with partner teams to deliver cohesive end-to-end experiences and ensure shared ownership of technical direction.
- Build Core Capabilities: Design and develop foundational platform components and reusable building blocks that accelerate innovation and team velocity.
- Other: Embody our culture and values
Qualifications
Required/Minimum Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred/Additional Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- 6+ years of experience designing, building, and operating production-grade software and services at scale, with a proven track record of delivering high-impact solutions.
- Proven experience in designing and building distributed systems and cloud-based services.
- Deep understanding of cloud platforms such as Azure, AWS, or GCP.
- Hands-on experience developing in AI-enhanced environments using tools like GitHub Copilot or similar.
- Hands-on experience with generative AI (GenAI) API platforms such as Azure AI Foundry, OpenAI, Claude, or similar.
- Familiarity with Authorization, Authentication and OAuth standard protocols, lifecycle and specifications.
- Familiarity with agentic protocols such as MCP or A2A.
- Excellent verbal and written communication skills, with the ability to clearly articulate complex technical concepts.
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Skills Required
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
- Pass Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
- 6+ years of experience designing, building, and operating production-grade software and services at scale.
- Proven experience designing and building distributed systems and cloud-based services.
- Deep understanding of cloud platforms such as Azure, AWS, or GCP.
- Hands-on experience developing in AI-enhanced environments using tools like GitHub Copilot or similar.
- Hands-on experience with generative AI platforms such as Azure AI Foundry, OpenAI, or Claude.
- Familiarity with Authorization, Authentication and OAuth protocols and lifecycle.
- Familiarity with agentic protocols such as MCP or A2A.
- Excellent verbal and written communication skills.
Microsoft Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.
-
Fair & Transparent Compensation — Pay is presented as broadly competitive overall, with clear role/level/location variation and an emphasis on using posted ranges and band information for apples-to-apples comparisons.
-
Retirement Support — Retirement benefits are described as a standout, highlighted by a strong 401(k) match structure and immediate vesting, plus additional plan features for tax-advantaged saving.
-
Parental & Family Support — Family-oriented benefits are portrayed as a meaningful strength, with substantial paid parental leave and added supports like back-up care and adoption/surrogacy assistance.
Microsoft Insights
What We Do
At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.
