File tree 4 files changed +5
-5
lines changed
4 files changed +5
-5
lines changed Original file line number Diff line number Diff line change @@ -103,7 +103,7 @@ Test the stack's OpenAI-compatible API by querying the available models:
103
103
104
104
.. code-block :: bash
105
105
106
- curl -o- http://localhost:30080/models
106
+ curl -o- http://localhost:30080/v1/ models
107
107
108
108
109
109
Expected output:
@@ -132,7 +132,7 @@ Send a query to the OpenAI `/completion` endpoint to generate a completion for a
132
132
133
133
.. code-block :: bash
134
134
135
- curl -X POST http://localhost:30080/completions \
135
+ curl -X POST http://localhost:30080/v1/ completions \
136
136
-H " Content-Type: application/json" \
137
137
-d ' {
138
138
"model": "facebook/opt-125m",
Original file line number Diff line number Diff line change @@ -103,7 +103,7 @@ Look for the following log message to confirm LMCache is active:
103
103
104
104
.. code-block :: bash
105
105
106
- curl -X POST http://localhost:30080/completions \
106
+ curl -X POST http://localhost:30080/v1/ completions \
107
107
-H " Content-Type: application/json" \
108
108
-d ' {
109
109
"model": "mistralai/Mistral-7B-Instruct-v0.2",
Original file line number Diff line number Diff line change @@ -95,7 +95,7 @@ helm install vllm vllm/vllm-stack -f tutorials/assets/values-04-multiple-models.
95
95
3. Query the `/models` endpoint to verify the models :
96
96
97
97
` ` ` bash
98
- curl http://localhost:30080/models
98
+ curl http://localhost:30080/v1/ models
99
99
` ` `
100
100
101
101
For details on the `/models` endpoint, refer to the [README.md](README.md).
Original file line number Diff line number Diff line change @@ -91,7 +91,7 @@ helm install vllm vllm/vllm-stack -f tutorials/assets/values-05-cpu-offloading.y
91
91
3. Send a request to the stack and observe the logs :
92
92
93
93
` ` ` bash
94
- curl -X POST http://localhost:30080/completions \
94
+ curl -X POST http://localhost:30080/v1/ completions \
95
95
-H "Content-Type: application/json" \
96
96
-d '{
97
97
"model": "mistralai/Mistral-7B-Instruct-v0.2",
You can’t perform that action at this time.
0 commit comments