Description
Bug Report
I have a localdocs created consisting of markdown files of the terraform documentation page about kubernetes provider. I have a api key added for GPT-4 and 4o. At first i had no issue using localdocs and either model. But at some point it stops working. I can send 1 message get back a error and then the whole chat is disabled and cannot send any message anymore. If I start a new chat with localdocs turned off everything works fine. the moment I turn on localdocs it stop working.
The error is Error: Failed to parse API model prompt: 8:468: Unexpected ''.
After writing this I try again and it works on my laptop (kubuntu 24.10). my guess it is some form of rate limit on the api which is not reflected back properly to GPT4ALL in chat.
Steps to Reproduce
- Create localdocs with markdown files
- Create a chat with GPT-4 or 4o
- use chat with localdocs enabled
- as far as I can tell randomly stops working
- from then on issue persists even in new chats
Expected Behavior
Chat should keep working
Your Environment
- Operating System: Windows 10 and also for Kubuntu 24.10
- Chat model used (if applicable): GPT-4 and 4o