Logging request/response data

[mrexodia]

Is there an option to log all request/response pairs to a folder or something? I tried redirecting stdout, but for the whisper transcription the audio_data is truncated.

[LostRuins]

Hm for that purpose I would recommend running it from your own custom python script using the API, and saving requests that way.

The regular output of the executable is not intended for logging large amounts of data - the truncation is intended since you don't want it to log a megabyte of audio data every time.

Here's a simple way to transcribe a single file:

curl -X POST http://localhost:5001/api/extra/transcribe -F "[email protected]"

[mrexodia]

Thanks for the reply! For my use case I have a lot of different scripts and tools interacting with kobold running on a separate machine. I think it will be easiest for me to use a proxy server and log the requests there, thanks!

[mrexodia]

I wrote this btw: https://github.com/mrexodia/logging-proxy, supports streaming and it can also be used as a library for more advanced use cases.

[dafranks]

What about the option to just log the user input?

I have added that as a script to mine, but I have to keep updating it on every release. Currently it logs my prompts with a timestamp/prompt into a date-named file.
I mainly use it when finetuning story generation so I can go back and re-create.

Would love to see an option in the Admin/Extra to pick a folder where prompts are logged.