Closed
Description
Name and Version
llama-server --version
ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
Device 0: NVIDIA GeForce RTX 4090, compute capability 8.9, VMM: yes
version: 5261 (cb06a3c)
built with cc (Debian 14.2.0-19) 14.2.0 for x86_64-linux-gnu
Operating systems
Linux
Which llama.cpp modules do you know to be affected?
llama-server
Command line
llama-server -m Llama-4-Scout-17B-16E-Instruct-Q4_0.gguf --port 7070 --host 0.0.0.0 --threads 24 -np 2 -ngl 99 -c 32768 -n 2000 -fa -l 8375-inf -l 10877-inf -l 45963-inf -l 27570-inf -l 21314-inf -l 26022-inf -l 125565-inf -l 82863-inf -l 262-inf -l 10338-inf -l 10877-inf --override-tensor ([1][1-9]|[2-9][0-9])\.ffn_.*_exps.=CPU,([1][1-9]|[2-9][0-9])\.ffn_router_exps.=CPU,([1][1-9]|[2-9][0-9])\.ffn_gate_exps.=CPU,
([7-9]|[1][0])\.ffn_.*_exps.=CPU,([7-9]|[1][0])\.ffn_router_exps.=CUDA0,([7-9]|[1][0])\.ffn_gate_exps.=CPU,([3-6])\.ffn_.*_exps.=CUDA0,([3-6])\.ffn_router_exps.=CUDA0,([3-6])\.ffn_gate_exps.=CUDA0,([0-2])\.ffn_.*_exps.=CUDA0,([0-2])\.ffn_router_exps.=CUDA0,([0-2])\.ffn_gate_exps.=CUDA0,\.tok_embeddings.*.=CUDA0Problem description & steps to reproduce
i biased all cats/dogs tokens to NEVER show up, but they do
First Bad Commit
No response
Relevant log output
example llama-server webui output in response to "a cat or a dog?"
The eternal debate!
Both cats and dogs can make wonderful pets, depending on your lifestyle, preferences, and needs. Here are some factors to consider:
**Cats:**
* Pros:
+ Independent and low-maintenance
+ Self-cleaning and don't need to be taken out for walks
+ Generally quiet and won't disturb neighbors
+ Affectionate on their own terms
* Cons:
+ Can be aloof and not as interactive
+ May scratch furniture or carpets if not provided with scratching posts
+ Require regular litter box cleaning
**Dogs:**
* Pros:
+ Loyal and loving, often forming strong bonds with owners
+ Encourage exercise and outdoor activities
+ Can be trained to behave well and perform tasks
+ Often social and enjoy interacting with people and other dogs
* Cons:
+ Require regular walks and exercise
+ Can be noisy and disturb neighbors
+ Need training and socialization to behave well
+ May require more attention and interaction than cats
Ultimately, the decision between a cat and a dog comes down to your:
1. **Lifestyle:** If you have a busy schedule or live in a small space, a cat might be a better fit. If you have a yard or enjoy outdoor activities, a dog might be a better match.
2. **Personality:** If you're an introvert or prefer a more low-key pet, a cat might suit you better. If you're an extrovert or enjoy socializing with your pet, a dog might be a better choice.
3. **Allergies:** If someone in your household has allergies, you may want to consider a hypoallergenic breed or a pet that's low-shedding.
Which one do you think you might prefer?