Top Tech Jobs & Startup Jobs

Design, build, and operate a multi-cluster, multi-tenant Kubernetes fleet for GPU inference. Extend Kubernetes with controllers/CRDs, implement GPU scheduling and autoscaling, own the network data plane, design cross-cluster connectivity and service mesh, drive reliability/SLOs, deliver IaC with Terraform/Helm/GitOps, and collaborate with platform, SRE, and security teams.

Design, build, and operate a multi-cluster, multi-tenant Kubernetes fleet for GPU inference. Own cluster architecture, custom controllers and CRDs, GPU scheduling, autoscaling, Kubernetes networking (CNI, IPAM, DNS, load balancing), cross-cluster connectivity, service mesh, and reliability SLOs. Deliver infrastructure-as-code and collaborate with platform, SRE, and security teams to support latency-sensitive, high-traffic inference workloads.

Design, implement, and optimize high-performance GPU kernels (GEMM, attention, routing), develop CUDA/ROCm C++ code including low-level assembly, implement reduced-precision/quantized kernels (FP8/FP4), benchmark and ensure parity across NVIDIA and AMD, contribute to GPU libraries, accelerate multi-modal pipelines, and integrate next-generation GPU features into production inference engine.

Own and evolve core backend microservices for an AI inference platform: build production-grade APIs, multi-tenant SaaS features (auth, RBAC, billing), design OLTP/OLAP data models, collaborate on multi-cloud orchestration, ensure reliability/performance, and drive engineering quality through testing and CI/CD.

Design, build, and maintain agent APIs and production agent applications for document understanding, advanced RAG, and customer support automation. Integrate open-source models, collaborate with backend and infra for deployment and monitoring, and ensure APIs are robust, scalable, and developer-friendly.

Own and evolve core backend microservices for an AI inference platform, building production-grade APIs and multi-tenant SaaS capabilities (authentication, RBAC, billing). Design data models and pipelines across PostgreSQL and ClickHouse, collaborate on multi-cloud orchestration, ensure reliability and performance, and drive engineering quality through testing and CI/CD.

Build and maintain the Python SDK and cross-platform CLI for an AI inference platform. Own packaging/distribution, developer tooling, DevOps automation, documentation, examples, and collaborate across frontend, product, and engineering to deliver ergonomic APIs and top-tier developer experience.

Design and optimize high-performance GPU kernels (GEMM, attention, routing) for AI inference across NVIDIA and AMD GPUs. Implement CUDA/C++ and low-level assembly code, build reduced-precision/quantized (FP8/FP4) kernels, benchmark cross-vendor performance, contribute to internal GPU libraries, accelerate multi-modal pipelines, and integrate next-generation GPU features into production.

Act as technical liaison for customers using FriendliAI's inference platform: onboard developers, provide technical support, create documentation and tutorials, debug production issues with engineering, and run demos and Q&A sessions.

Design, build, and maintain a scalable web platform and APIs for deploying and monitoring multimodal AI models and agent workflows. Collaborate with product, infrastructure, and design teams to optimize performance, ensure reliability, drive CI/CD and testing, and contribute to long-term architecture decisions for a cloud-native, multi-tenant SaaS system.