feat: Provide a completely offline installation method

[SnDream]

Quick Check ✨

• I've taken a look at existing feature requests
• This feature request relates to GAIA UI (Open-WebUI)

What's on your mind?

I'd like a way to install the entire package completely offline.

The current installation method is a bit difficult for scenarios with poor network conditions or no internet access, as the process still requires downloading various components on the spot, including even the model itself.

After installation and opening, the GAIA UI still needs to download things on the spot (I don't even know how to configure proxy settings for downloads here, or complete this in offline mode). To some extent, since the device itself is capable of such massive downloads anyway, it almost defeats the purpose – I might as well just use an online AI service for convenience.

Since purchasing the HX370, I've been looking forward to seeing the NPU actually work with LLMs. Your work takes a real step toward making the NPU truly useful – thank you so much. (Also, with 64GB RAM on my machine, can it run a 14B model on the NPU?)

[itomek]

Hi @SnDream, offline support for GAIA UI is on the table, as well as a slimming down process, stay tuned for future releases.

In regards to:

with 64GB RAM on my machine, can it run a 14B model on the NPU?

Based on the numbers, a 14BQ4 model could fit the NPU, AMD doesn't have a model in that spec. However, there are plenty of hybrid models available at AMD hybrid collection on Hugging Face that you can use.