Skip to content

AttributeError: 'Thread' object has no attribute '_stop_tokens' #18

@dkainer

Description

@dkainer

HI,
I can't seem to get things to work with the Thread.send() function because it tells me:

AttributeError: 'Thread' object has no attribute '_stop_tokens'

The model is Qwen3-4B-Q4_K_M.gguf.
Here is my basic code:

import easy_llama as ez

mymodel = ez.Llama(
        path_model = 'my/path/to/llama.cpp/models/Qwen3-4B-Q4_K_M.gguf',
        n_gpu_layers = -1,
        offload_kqv = True)

MyThread = ez.Thread(mymodel, sampler_preset = ez.SamplerPresets.Qwen3Thinking)

MyThread.add_message(role = ez.Role.SYSTEM, content = "you are a helpful buddy")
MyThread.send(content = "how long is a piece of string?")

Traceback (most recent call last):
File "", line 1, in
File "easy_llama/thread.py", line 178, in send
stop_tokens=self._stop_tokens,
AttributeError: 'Thread' object has no attribute '_stop_tokens'

Would really appreciate some help to get this working!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions