You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Would it be possible to provide a version of this recipe adapted for Runpod vLLM Serverless
In particular, guidance on the required GPUs and the appropriate vLLM configuration would be very helpful.
This would make it much easier for those of us looking to deploy on Runpod’s serverless platform directly.