Senior Software Engineer, AI Gateway

Posted 3 Days Ago
Be an Early Applicant
Milan, ITA
In-Office
Senior level
Artificial Intelligence • Cloud • Information Technology • Software • Big Data Analytics
The AI Connectivity Company
The Role
Design and lead development of high-performance AI Gateway components in Golang. Own scalable distributed-system architecture, reliability, testing, observability, and CI/CD. Mentor engineers, resolve complex performance issues, influence technical roadmaps, and collaborate with product, SRE, and engineering teams. The role focuses on secure AI/ML connectivity, API gateway infrastructure, cloud-native technologies, and a strong developer experience.
Summary Generated by Built In

Are you ready to unlock intelligence?

If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.

The Mission

The AI Gateway team is on a mission to build the central nervous system for the agentic era, enabling developers to securely and reliably connect, observe, and manage their AI and ML services at scale. We are architecting the foundational layer that will power the next generation of intelligent applications. Your work will directly impact developer delight and ensure our infrastructure is the most trusted path for AI traffic in the world.

What You’ll Do
  • Design, own, and lead the development of critical, high-performance components for Kong’s AI Gateway using Golang.

  • Influence the technical roadmap and architecture, ensuring our systems are scalable, resilient, and prepared for future challenges.

  • Architect solutions that prevent technical debt and maintain our commitment to 99.99% uptime and reliability.

  • Mentor and guide other engineers on the team, fostering a culture of technical excellence and collaborative problem-solving.

  • Drive best practices in testing, observability, and continuous integration/delivery within a complex, distributed environment.

  • Collaborate cross-functionally with product management, SRE, and other engineering teams to deliver a world-class developer experience.

  • Resolve complex technical issues and conduct deep-dives into system performance, identifying and addressing bottlenecks.

What You’ll BringThe Toolkit
  • Extensive professional experience building software in a systems language like Golang or Python.

  • Deep understanding of distributed systems, microservice architectures, and API design principles.

  • Proven experience with cloud-native technologies, including Kubernetes and Docker.

  • Experience with or a strong interest in AI/ML infrastructure, such as LLM orchestration, vector databases, or model serving.

  • Solid knowledge of networking fundamentals (TCP/IP, HTTP/2, gRPC).

The Kong DNA
  • Ownership: You are a proactive problem-solver with a bias for action, taking full ownership of your work from concept to production.

  • Urgency: You thrive in a fast-paced, high-growth environment, and you are driven to deliver results quickly and efficiently.

  • Collaboration: You are an excellent communicator who works effectively with a globally distributed team to achieve shared goals.

Bonus Points
  • Contributions to open-source software projects.

  • Experience with Nginx, Lua, or service mesh technologies.

  • Familiarity with AI frameworks like LangChain, PyTorch, or TensorFlow.

  • Prior experience building API gateways, developer platforms, or large-scale infrastructure-as-a-service products.

#LI-EA1

About Kong:

Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit www.konghq.com.

Skills Required

  • Extensive professional software development experience using a systems language such as Golang or Python.
  • Deep understanding of distributed systems, microservice architectures, and API design principles.
  • Professional experience with cloud-native technologies, including Kubernetes and Docker.
  • Experience with or strong interest in AI/ML infrastructure, including LLM orchestration, vector databases, or model serving.
  • Solid knowledge of networking fundamentals, including TCP/IP, HTTP/2, and gRPC.
  • Contributions to open-source software projects.
  • Experience with Nginx, Lua, or service mesh technologies.
  • Familiarity with LangChain, PyTorch, or TensorFlow.
  • Experience building API gateways, developer platforms, or large-scale infrastructure-as-a-service products.

Kong Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Kong and has not been reviewed or approved by Kong.

  • Leave & Time Off Breadth — Flexible PTO, company-wide Unplug Days, and a four‑week paid sabbatical after five years are prominently offered to support rest and work–life balance. These programs are presented as meaningful perks beyond base pay and are highlighted across official materials and third‑party summaries.
  • Healthcare Strength — U.S. medical, dental, and vision coverage is described as strong, with plan quality drawing positive sentiment. Solid healthcare appears to contribute meaningfully to overall satisfaction with the total package.
  • Equity Value & Accessibility — Stock options are offered to most employees, creating ownership upside alongside cash compensation. Equity is positioned as a visible component that helps keep offers competitive for certain technical and go‑to‑market roles.

Kong Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
1,000 Employees
Year Founded: 2017

What We Do

Kong Inc., a leading developer of API and AI connectivity technologies, is building the connectivity layer for AI. Trusted by the Fortune 500 and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. No AI without APIs.

Why Work With Us

It starts with how we show up for each other. We’ve created a workplace that’s intentionally flexible, deeply inclusive, and built for meaningful collaboration — whether virtual or in person. We trust our teams to own their work, and we give them the support, tools, and freedom to grow.

Gallery

Gallery

Similar Jobs

Kong Logo Kong

Senior Software Engineer

Artificial Intelligence • Cloud • Information Technology • Software • Big Data Analytics
In-Office
Milan, ITA
1000 Employees

Tulip Logo Tulip

Senior Customer Success Manager

Enterprise Web • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
27 Locations
310 Employees

Pfizer Logo Pfizer

Medical Channel Strategy and Engagement Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
34 Locations
121990 Employees
231K-385K Annually

Mondelēz International Logo Mondelēz International

o9 Change Readiness Lead

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
11 Locations
90000 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account