How to bind localDocs when accessing a local server via API?

[zhouruicn]

I have successfully created embedded LocalDocs, and they function correctly when selected through the UI,How to bind localDocs when accessing a local server via API?

[cosmic-snow]

Do you mean the language bindings or the web server API?

In any case, the part of the code which handles LocalDocs is implemented in the chat application, the language bindings sit at a lower level and don't have access to that code. The web server API is currently limited, too.

Basically, you'd have to implement that yourself; The database (localdocs_v2.db) is an SQLite DB, so you can definitely access that in your own code.

(At least this is the state of things as of 2024-07-20.)

[zhouruicn]

I apologize for my confusing wording. I wanted to ask how to achieve the equivalent of "select a collection to make it available to the chat model" when accessing via http://127.0.0.1:4891/v1/chat/completions, just like through the UI. Your response suggests this functionality is not yet available through the API.

[cosmic-snow]

It isn't, no. Sorry.

[cosmic-snow]

@zhouruicn I think I should clarify. When using the built-in API server:

• There is no way to activate LocalDocs with some parameter from the client which is making requests to the API server. There is an open issue about that.

• You can activate LocalDocs from within the GUI. To do that:

  1. Enable the server (obviously).
  2. Open the Chats view and open both sidebars.
  3. Scroll down to the bottom in the left sidebar (chat history); the last entry will be for the server itself. Activate that chat; it has a different backgroud colour so you know you're picking the right one.
  4. Activate one or more LocalDocs collections in the right sidebar.
  5. Use a client and make server requests now.

[CarlosGon]

i did your recommended steps, but even so, via api the model does not seems to know about the documents, with same prompt used on GUI.
i am also outputing the reference values from content response and i can see that when the LocalDocs library is marked on the gui server chat, we always have the references filled with snippets of the documents. When LocalDocs library is not marked on the gui server chat the reference filed does not exists on the response content.
For what you explained seems that model should be able to use the docs giving responses based on these.