Top Tech Jobs & Startup Jobs

Design, optimize, and operate production LLM inference and training pipelines. Improve latency, throughput, and GPU utilization using techniques like batching, quantization, FlashAttention, and kernel-level profiling. Deploy and autoscale multiple models on shared GKE GPU clusters, consult with clients on performance and cost requirements, and carry prototypes to robust, scalable production services.