Swich Ray templates to use vLLM API #153
Description
Community Note
- Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
- Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
- If you are interested in working on this issue or have submitted a pull request, please leave a comment
What is the outcome that you are trying to reach?
Remove the vllm_serve.py script for ray and use the vllm api
Describe the solution you would like
Remove the vllm_serve.py script for ray and use the vllm api