Skip to content

Commit

Permalink
improve caching docs (#295)
Browse files Browse the repository at this point in the history
Based on feedback from user trying it out.
  • Loading branch information
samos123 authored Oct 29, 2024
1 parent 6434766 commit 04d8f56
Show file tree
Hide file tree
Showing 2 changed files with 22 additions and 1 deletion.
4 changes: 3 additions & 1 deletion docs/how-to/cache-models-with-aws-efs.md
Original file line number Diff line number Diff line change
Expand Up @@ -118,7 +118,7 @@ Make sure to set `file_system_id` match the EFS file system ID created in the fi

## 3. Configure KubeAI with the EFS cache profile

You can skip this step if you've already installed KubeAI using the [EKS Helm values file: values-eks.yaml](https://github.com/substratusai/kubeai/blob/main/charts/kubeai/values-eks.yaml) file.
You can skip this step if you've already installed KubeAI using the [EKS Helm values file: values-eks.yaml](https://github.com/substratusai/kubeai/blob/main/charts/kubeai/values-eks.yaml).

Configure KubeAI with the `efs-dynamic` cache profile.
```bash
Expand All @@ -133,6 +133,8 @@ cacheProfiles:
persistentVolumeName: "efs-pv"
EOF
```
You can also manually provision a PersistentVolume using EFS static mode.
The efs-static profile is used for this purpose.

## 4. Configure a model to use the EFS cache

Expand Down
19 changes: 19 additions & 0 deletions docs/how-to/cache-models-with-gcp-filestore.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,25 @@ Ensure that the Filestore API is enabled.
gcloud services enable file.googleapis.com
```

## 1. Configure KubeAI with Caching Profile

You can skip this step if you've already installed KubeAI using the [GKE Helm values file: values-gke.yaml](https://github.com/substratusai/kubeai/blob/main/charts/kubeai/values-gke.yaml).

Configure KubeAI with the Filestore cache profiles.
```bash
helm upgrade --install kubeai kubeai/kubeai \
--reuse-values -f - <<EOF
cacheProfiles:
standard-filestore:
sharedFilesystem:
storageClassName: "standard-rwx"
premium-filestore:
sharedFilesystem:
storageClassName: "premium-rwx"
EOF
```

## 2. Deploy a model that uses the Filestore Caching Profile
Apply a Model with the cache profile set to `standard-filestore` (defined in the reference [GKE Helm values file](https://github.com/substratusai/kubeai/blob/main/charts/kubeai/values-gke.yaml)).

<details markdown="1">
Expand Down

0 comments on commit 04d8f56

Please sign in to comment.