Are you ready to unlock intelligence?
If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.
The MissionThe AI Gateway team is on a mission to build the central nervous system for the agentic era, enabling developers to securely and reliably connect, observe, and manage their AI and ML services at scale. In this role you will design and build the core of the gateway that handles live AI traffic: the runtime and data plane that route, translate, secure, and observe every request, with the performance and reliability our customers depend on.
What You’ll DoOwn the technical direction for core AI Gateway features, from design to production rollout.
Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua.
Implement gateway features such as multi-LLM routing and load balancing, caching, guardrails, and observability for AI traffic.
Design integrations with LLM providers and AI platforms, filling the gaps between Kong and third-party deployment platforms and tooling.
Influence the technical roadmap and architecture, and address technical debt before it limits scalability.
Investigate complex production issues and performance bottlenecks, and do low-level optimizations in the hot path.
Work with product management and other engineering teams to turn customer requirements into reliable, documented product features.
Mentor other engineers on the team through code reviews and design discussions.
5+ years of programming in server-side applications and components, in a language such as Rust or Go.
Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.
Knowledge of networking fundamentals and protocols on both L4 and L7 (TCP/IP, HTTP/2, gRPC).
Solid understanding of API design, and familiarity with API gateways, proxies, or service mesh.
Experience with LLMs and AI infrastructure, such as LLM provider APIs, agent frameworks, model serving, MCP and other agentic AI protocols.
Solid hands-on expertise in Linux systems, including troubleshooting memory issues and profiling processes.
Ownership: You take full ownership of your work from concept to production, including the documentation: engineers at Kong write the documentation for their products.
Urgency: You balance quality with the need to deliver value to customers quickly.
Collaboration: You communicate clearly in writing and work effectively with a remotely distributed team.
Leadership: You make and explain technical trade-offs where there is no established playbook.
Contributions to open-source software projects.
Proficiency with Lua.
Hands-on experience with NGINX and OpenResty.
Experience operating services in cloud-native environments (Kubernetes, Docker, AWS/GCP/Azure).
#LI-EA1
About Kong:
Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit www.konghq.com.
Skills Required
- Extensive backend development experience, preferably with Golang and/or Python
- Deep understanding of distributed systems, microservices architecture, and API design principles
- Proven experience designing and operating services in a cloud-native environment
- Experience with Kubernetes, Docker, and at least one major cloud platform such as AWS, GCP, or Azure
- Familiarity with API gateways, service mesh, or related infrastructure technologies
- Strong computer science fundamentals, including data structures, algorithms, and concurrency
- Experience with AI/ML infrastructure, LLMs, or frameworks such as LangChain or LlamaIndex
- Contributions to open-source projects
- Experience tuning and optimizing high-throughput systems
- Knowledge of Lua or OpenResty
Kong Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Kong and has not been reviewed or approved by Kong.
-
Leave & Time Off Breadth — Flexible PTO, company-wide Unplug Days, and a four‑week paid sabbatical after five years are prominently offered to support rest and work–life balance. These programs are presented as meaningful perks beyond base pay and are highlighted across official materials and third‑party summaries.
-
Healthcare Strength — U.S. medical, dental, and vision coverage is described as strong, with plan quality drawing positive sentiment. Solid healthcare appears to contribute meaningfully to overall satisfaction with the total package.
-
Equity Value & Accessibility — Stock options are offered to most employees, creating ownership upside alongside cash compensation. Equity is positioned as a visible component that helps keep offers competitive for certain technical and go‑to‑market roles.
Kong Insights
What We Do
Kong Inc., a leading developer of API and AI connectivity technologies, is building the connectivity layer for AI. Trusted by the Fortune 500 and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. No AI without APIs.
Why Work With Us
It starts with how we show up for each other. We’ve created a workplace that’s intentionally flexible, deeply inclusive, and built for meaningful collaboration — whether virtual or in person. We trust our teams to own their work, and we give them the support, tools, and freedom to grow.
Gallery







