Skip to content
This repository has been archived by the owner on May 28, 2024. It is now read-only.

Commit

Permalink
Update README.md for rayllm
Browse files Browse the repository at this point in the history
Signed-off-by: akshay-anyscale <[email protected]>
  • Loading branch information
akshay-anyscale authored May 28, 2024
1 parent 9251fb5 commit 400df51
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,10 @@
============================
# Archiving Ray LLM

We had started RayLLM to simplify setting up and deploying LLMs on top of Ray Serve. In the past few months, vLLM has made significant improvements in ease of use. We are archiving the RayLLM project and instead adding some examples to our Ray Serve docs for deploying LLMs with Ray Serve and vLLM. This will reduce another library for the community to learn about and greatly simplify the workflow to serve LLMs at scale. We also recently launched Hosted Anyscale where you can serve LLMs with Ray Serve with some more capabilities out of the box like multi-lora with serve multiplexing, JSON mode function calling and further performance enhancements.


============================
# RayLLM - LLMs on Ray

The hosted Aviary Explorer is not available anymore.
Expand Down

0 comments on commit 400df51

Please sign in to comment.