Model Not Responding to User After First Execution in a Specific Initialization Case #941
Unanswered
Leirbag999
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello, I’m facing an issue with an application I developed using LLamasharp, which manages agents responsible for executing specific tasks. The flow works as follows: the user sends a query, which is combined with a template containing instructions for the model to call specific functions. These functions return the corresponding responses, which are then used by the model to respond to the user.
The problem is that after the function is called and the correct response is returned, the LLM doesn’t respond to the user as expected. Instead, it keeps calling the function repeatedly, entering an infinite loop, as if it doesn’t correctly interpret that it should end the process by responding to the user with the SendMessage function.
I conducted a test by placing the template in a string and passing it directly to the model the first time it is loaded. The difference is that, previously, I would load the model, and the first message sent would be a request to execute a function. However, when the model is initialized with the pre-structured template in the first run, it correctly calls the function without entering the loop.
I’d appreciate help in understanding what could be causing this behavior.
Beta Was this translation helpful? Give feedback.
All reactions