Recent Posts
kserve-poc This is a proof of concept for using Kserve as model serving infrastructure. Its ability to scale models individually and also scales to zero is helpful for performance and cost.
Installation Pre-requisites A k8s cluster kubectl Helm A GCS bucket Installing Kserve 0. Create a namespace for testing kubectl create namespace kserve-test Reference doc: https://kserve.github.io/website/master/admin/serverless/serverless/
1. Install Knative Serving Reference: https://knative.dev/docs/install/yaml-install/serving/install-serving-with-yaml/#install-the-knative-serving-component
1.1 Install Knative Serving CRDs kubectl apply -f https://github.
read more