Feature request: provide basic RAM/VRAM usage metrics in web ui

This would be helpful, as this project provides orchestration of various backends. 
Initial configuration involves careful monitoring of VRAM utilization to avoid OOM or CPU offloading.

Normally one would use rocm-smi or nvidia-smi for it, but enabling this in the web interface would it make easier to see it as a glance.

