-
Notifications
You must be signed in to change notification settings - Fork 5
Open
Description
HI,
I can't seem to get things to work with the Thread.send() function because it tells me:
AttributeError: 'Thread' object has no attribute '_stop_tokens'
The model is Qwen3-4B-Q4_K_M.gguf.
Here is my basic code:
import easy_llama as ez
mymodel = ez.Llama(
path_model = 'my/path/to/llama.cpp/models/Qwen3-4B-Q4_K_M.gguf',
n_gpu_layers = -1,
offload_kqv = True)
MyThread = ez.Thread(mymodel, sampler_preset = ez.SamplerPresets.Qwen3Thinking)
MyThread.add_message(role = ez.Role.SYSTEM, content = "you are a helpful buddy")
MyThread.send(content = "how long is a piece of string?")
Traceback (most recent call last):
File "", line 1, in
File "easy_llama/thread.py", line 178, in send
stop_tokens=self._stop_tokens,
AttributeError: 'Thread' object has no attribute '_stop_tokens'
Would really appreciate some help to get this working!
Metadata
Metadata
Assignees
Labels
No labels