libllama.so is 64-bit instead of 32-bit error when trying to load the model on my Samsung Device

[VigneshPasupathy]

Hi,

I tried using Orca mini 3B q4_0 (https://huggingface.co/TheBloke/orca_mini_3B-GGML/tree/main) model with this repo on my Samsung Galaxy M13 Android Device with 6GB Ram.

I get the following error while trying to load the model.

Failed to load dynamic library '/data/user/0/com.biprep.sherpa/app_flutter/libllama.so': dlopen failed: "/data/data/com.biprep.sherpa/app_flutter/libllama.so" is 64-bit instead of 32-bit

Have u faced this error previously? or is there a different .so file I can use on my device?

[Tabiena]

When I install the apk from this repo on my phone, the app loads the model but shuts down immediately after entering the prompt without giving an error message. I don't think this app works with ggml version 3 (like the Orca mini). Try the apk from the fork: https://github.com/dsd/sherpa/releases/tag/2.2.1-dsd2