Modify the NIMs how to guide after upgrading to KServe 0.14

[NohaIhab]

Context

The Deploy NVIDIA NIM on Charmed Kubeflow how to guide is currently deviating from the NVIDIA’s runtime YAMLs by setting the NIM_CACHE_PATH to /tmp. This is to avoid hitting the issue kserve/kserve#3687 in KServe with downloading models into PVCs.
However, this issue is expected to be fixed in KServe version 0.14 and Charmed Kubeflow 1.10 will be supporting KServe 0.14. Once we bump the KServe version in CKF to 0.14 i.e. release CKF 1.10, we should update this how to guide to use the NVIDIA runtime YAMLs, where PVs and PVCs are being utilized.

What needs to get done

Update the runtime in the how to guide to use PVCs

Definition of Done

NIMs how to guide is updated and approved

[syncronize-issues-to-jira]

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/KF-6496.

This message was autogenerated