Skip to content
This repository was archived by the owner on Aug 7, 2025. It is now read-only.

Commit a59e85c

Browse files
committed
Re-add test for llama.cpp example
1 parent b1a45f0 commit a59e85c

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

cpp/test/examples/examples_test.cc

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,3 +8,12 @@ TEST_F(ModelPredictTest, TestLoadPredictBabyLlamaHandler) {
88
"test/resources/torchscript_model/babyllama/babyllama_handler",
99
"test/resources/torchscript_model/babyllama/prompt.txt", "llm_ts", 200);
1010
}
11+
12+
TEST_F(ModelPredictTest, TestLoadPredictLlmHandler) {
13+
this->LoadPredict(
14+
std::make_shared<torchserve::LoadModelRequest>(
15+
"test/resources/torchscript_model/llamacpp/llamacpp_handler", "llm",
16+
-1, "", "", 1, false),
17+
"test/resources/torchscript_model/llamacpp/llamacpp_handler",
18+
"test/resources/torchscript_model/llamacpp/prompt.txt", "llm_ts", 200);
19+
}

0 commit comments

Comments
 (0)