Teams at FriendliAI

Customer-facing engineer who deploys, scales, and operates LLM and multimodal inference workloads. Build and manage containerized deployments on Kubernetes, create Terraform/Helm automation, diagnose production performance issues, integrate with customers' CI/CD pipelines, and provide reliability and observability guidance through workshops and hands-on support.

Design, build, and operate a multi-cluster, multi-tenant Kubernetes fleet for GPU inference. Extend Kubernetes with controllers/CRDs, implement GPU scheduling and autoscaling, own the network data plane, design cross-cluster connectivity and service mesh, drive reliability/SLOs, deliver IaC with Terraform/Helm/GitOps, and collaborate with platform, SRE, and security teams.

Design, build, and operate a multi-cluster, multi-tenant Kubernetes fleet for GPU inference. Own cluster architecture, custom controllers and CRDs, GPU scheduling, autoscaling, Kubernetes networking (CNI, IPAM, DNS, load balancing), cross-cluster connectivity, service mesh, and reliability SLOs. Deliver infrastructure-as-code and collaborate with platform, SRE, and security teams to support latency-sensitive, high-traffic inference workloads.