Qwen 3 FIM?

[laurentpayot]

Hi,

Qwen 3 was released yesterday, and it seems it’s a big improvement compared to Qwen 2.5.

When I run Qwen 3 (8B, 4B or 0.6B) in order to use it for FIM, all it does is thinking for a (very) long time and then it produces no suggestion (no 501 error). Qwen 2.5 Coder is working fine.

Do you know if it is possible to use Qwen 3 for FIM, or do we have to wait for a Qwen 3 Coder release?

Thanks for this nice plugin!

Cheers,
Laurent

[ggerganov]

We need to wait for Qwen 3 Coder.

[stuta]

Testing too, it's really fast model. How can I add "/no_think" to the start of the prompt?

[ggerganov]

There isn't a good way to add "/no_think". The models are not supposed to be used for FIM anyway. We have to wait for the "Coder" family.