BitNet 1-bit Model (microsoft/bitnet-b1.58-2B-4T) Not Supported

[Conghung43]

Describe the bug

I’ve tested LLMUnity with the microsoft/bitnet-b1.58-2B-4T model from Hugging Face, and it seems this 1-bit LLM model is currently not supported or cannot run properly in the framework.

Would be great to confirm whether:

1-bit quantized models like BitNet are expected to work with LLMUnity

Or if this is a known limitation

If possible, it would be helpful to add a note in the documentation or extend support in future versions.

Thanks for the great project — looking forward to your feedback!

Steps to reproduce

No response

LLMUnity version

No response

Operating System

None

[amakropoulos]

hi! this is a very recent model.
It will work when I update the llama.cpp backend to the latest version in the next release.