kserve on Yang Caohttps://yc2984.github.io/tags/kserve/Recent content in kserve on Yang CaoHugoen-gbTue, 02 Apr 2024 10:00:00 +0200Serving models on Kubernetes with KServehttps://yc2984.github.io/posts/serving-models-on-kubernetes-with-kserve/Tue, 02 Apr 2024 10:00:00 +0200https://yc2984.github.io/posts/serving-models-on-kubernetes-with-kserve/Scale-to-zero sounds free until you meet the cold start. What KServe actually buys you, what it quietly costs, and why we turned the headline feature off in the end.