Can GPT4All run on GPU or NPU? #2115
Closed
TerrificTerry
started this conversation in
General
Replies: 2 comments
-
|
Converted to an issue: #2122 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I had to close #2122 since you did not reply. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I'm currently trying out the Mistra OpenOrca model, but it only runs on CPU with 6-7 tokens/sec. My laptop has a NPU (Neural Processing Unit) and an RTX GPU (or something close to that). I read the release notes and found that GPUs should be supported, but I can't find a way to switch to GPU in the applications settings. Only CPU and auto are presented. Does anybody have an idea to deal with this?
Beta Was this translation helpful? Give feedback.
All reactions