CLI stats invalid parameter

[taikai-zz]

stats: View model performance statistics
From the logs, we did not see any performance statistics of the server

[kovtcharov]

Hi @taikai-zz, the --stats option only applies to the Lemonade server backend. I will update the documentation to reflect this. Thanks for bringing it up.

If you do want to check statistics with ollama, you can use the --verbose flag when starting the ollama backend (should be an easy change in the code to do this). Can also add this option in the CLI tool if it might be useful.

[taikai-zz]

HI @kovtcharov

In the document - backend: Select inference backend ["oga", "hf", "ollama"] (default: "ollama"), there is no Lemonade server backend. How to write the complete command statement?

[itomek]

Hi, @taikai-zz if installing in Hybrid mode on supported hardware, lemonade becomes an option to install, when installed, GAIA will use Lemonade by default.

[kovtcharov]

Lemonade uses the onnx runtime genai (OGA) backend so "oga" is essentially the lemonade backend. The code for this can be found here.