Skip to content

<think> sections should not be part of the response #23

@lienharc

Description

@lienharc

<think>...</think> sections should be removed from the LLM's response (Albeit not sure what to do if we implement streaming).

These tags are always annoying. If I summarize I don't want to read through the thinking process, if I want to compose an E-Mail I don't want to know the thinking process and if I want my subject line, I definitely do not want the think section.

Find out whether these tags are a TNG creation or common practice.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions