kubernetes — Yang Cao

Skip to content

GitHub LinkedIn RSS

Serving models on Kubernetes with KServe

Scale-to-zero sounds free until you meet the cold start. What KServe actually buys you, what it quietly costs, and why we turned the headline feature off in the end. 02.04.2024
11 min