Software Engineer - GitHub Copilot API

Reposted 22 Days Ago
Be an Early Applicant
Hiring Remotely in CZ
Remote
966K-2M Annually
Entry level
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
The Role
Build and operate scalable backend services and APIs powering GitHub Copilot. Develop LLM routing and orchestration for model selection, fallbacks, retries, guardrails, and request shaping. Improve latency, reliability, observability, quality, and cost efficiency through design, testing, metrics, safe deployments, and monitoring. Collaborate with engineering, product, and AI partners, participate in on-call rotations, write architecture proposals, and mentor peers through technical leadership and code reviews.
Summary Generated by Built In
Overview

GitHub is looking for a Software Engineer II (L62) to join the Copilot API Platform Frameworks team. This role focuses on building and maintaining backend services and APIs that power GitHub Copilot and its integrations, with an emphasis on sound technical design, service performance, reliability at scale, and intelligent LLM request routing. 

The ideal candidate has experience building and operating distributed systems in production and enjoys working close to the details of system behaviour, latency, and failure modes. You will contribute to technical designs for the features you own, clarifying requirements, proposing approaches, and making pragmatic trade-offs, while partnering with senior engineers to align with broader platform architecture. You care about building services that are observable, efficient, and resilient, and about designing routing and orchestration layers that optimise quality, speed, and cost. 

As a Software Engineer III on the Copilot API team, you will collaborate with a distributed, diverse group of engineers, product managers, and AI-focused partners across GitHub to deliver improvements that other engineers can depend on. You will help design, implement, and iterate on APIs and service components that underpin Copilot’s scalability, reliability, and intelligence, taking responsibility for a defined area while coordinating dependencies and rollout plans with your team. 

You will contribute through hands-on implementation, clear design communication, and strong collaboration. You’ll write and review design docs for your work, define success metrics (e.g., latency, error rate, throughput, routing quality, and cost efficiency), and improve performance and reliability through testing, safe deployments, and monitoring. You will participate in on-call and first responder rotations, resolving issues within SLOs and escalating when needed, and help continuously improve the resilience and maintainability of the services you touch. At GitHub, we value developer empathy, transparency, and inclusive collaboration, and we work iteratively with a bias toward action and impact. 


Responsibilities
  • Design, develop, test, and ship high-quality technical solutions that scale across multiple GitHub services.  

  • Build and evolve LLM routing/orchestration capabilities (e.g., model/endpoint selection, fallback, retries, guardrails, and request shaping) to optimise user experience, quality, latency, and cost.  

  • Design and implement APIs and service components that support Copilot integrations and intelligent inference pathways.  

  • Collaborate cross-functionally with engineering, product, and applied AI partners to define and deliver innovative solutions.  

  • Own and advocate for system health and quality, including participation in on-call and first responder rotations.  

  • Write architecture briefs and proposals, run experiments/prototypes, and use production signals to drive iterative improvements.  

  • Define and track success metrics, including platform reliability metrics (SLOs) and routing effectiveness metrics.  

  • Use CI/CD and safe deployment practices to deliver changes confidently and quickly.  

  • Mentor peers through technical leadership, pairing, and thoughtful code/design reviews. 

  • Become intimately familiar with the systems you build and take pride in writing maintainable code. 


Qualifications

Required Qualifications: 

  • Degree in Computer Science or related technical field, OR equivalent experience.
  • Demonstrated technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python OR equivalent experience.

Preferred Qualifications: 

  • Experience in one or more scripting languages (e.g., Bash, Python, or a similar language).

  • Experience using general purpose programming languages (e.g., Go, Ruby, or a similar language). 

  • Experience with cloud environments and/or Cloud Native Compute Foundation (CNCF) concepts. 



Software Engineering IC3 - The typical base pay range for this role across Czechia is Kč 966,000.00 - Kč 1,727,000.00 per year. Certain roles may be eligible for benefits and other compensation.

Find additional benefits and pay information here:
https://careers.microsoft.com/v2/global/en/corporate-pay/czech-republic-corporate-pay.html


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

  • Degree in Computer Science or a related technical field, or equivalent experience
  • Technical engineering experience with coding in one or more languages including C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python, or equivalent experience
  • Experience in one or more scripting languages such as Bash or Python
  • Experience with general-purpose programming languages such as Go or Ruby
  • Experience with cloud environments and/or Cloud Native Computing Foundation concepts

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

  • Healthcare Strength — Medical, dental, and vision coverage is described as comprehensive, with U.S. plans covering preventive care at 100% and limiting annual out-of-pocket costs. Mental-health counseling, employee assistance, and wellbeing resources are also emphasized.
  • Parental & Family Support — Parental leave, family-caregiver leave, childcare assistance, and family concierge services are highlighted as core elements. These supports are presented alongside parenting and family-planning resources.
  • Leave & Time Off Breadth — Vacation, holidays, and flexible work schedules are emphasized, with generous time-away policies noted. Leave options extend beyond standard vacation to include caregiver and parental programs.

Microsoft Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redmond, WA
206,870 Employees
Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.

Similar Jobs

ServiceNow Logo ServiceNow

Account Executive

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Prague, CZE
29000 Employees

Argyle Logo Argyle

Senior Data Analyst

Big Data • Cloud • Fintech • Professional Services • Software
Remote
27 Locations
80 Employees
70K-85K Annually

Pfizer Logo Pfizer

Director, Oncology Scientific Communications

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
34 Locations
121990 Employees
177K-294K Annually

Pfizer Logo Pfizer

Director, AI Product Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account