AI: Kimi K2 tool calls don't work in openrouter #37032
Replies: 11 comments
-
Same issue here. I ignored DeepInfra which uses fp4 quantization. But when my requests are served by novita/fp8, it is still the same. |
Beta Was this translation helpful? Give feedback.
-
Temporary solution, add Baseten, DeepInfra, Moonshot AI, Groq providers to the ignore list |
Beta Was this translation helpful? Give feedback.
-
Could you please provide a bit more detail here? Which ignore list? |
Beta Was this translation helpful? Give feedback.
-
Ignored providers in OpenRouter settings. Baseten, DeepInfra are the main ones that get confused of calling tools |
Beta Was this translation helpful? Give feedback.
-
Unfortunately I have a custom openai-compatible inference backend, so that won't work But I guess it's a valid workaround for open router that'll help almost everyone, thanks for the clarification |
Beta Was this translation helpful? Give feedback.
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
This comment was marked as off-topic.
-
With Qwen 2.5 Coder it is the same - nothing happens on tool_call s. It does also not help to ask KI to switch to e.g. Hermes Style . |
Beta Was this translation helpful? Give feedback.
-
Yup, in most cases, I got the same result even with Qwen3-coder. Haven't specifically tested GLM-4.5. However, Grok-4 can use Zed |
Beta Was this translation helpful? Give feedback.
-
Heh. I connected kimi k2, and Clode responds. (via OpenRouter) The blocking from the advice above does not change the situation. |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Summary
Kimi K2 (both via openrouter and custom API) can't call any tools.
Description
Steps to trigger the problem:
Expected Behavior: The tool call to list_files is successful
Actual Behavior: The tool is not called, and the model outputs something like "I'll help you list the files in this project. Let me show you what's available:". It seems like the tool call just isn't recognized.
Model Provider Details
Zed Version and System Specs
Zed: v0.194.3 (Zed)
OS: macOS 15.5.0
Memory: 36 GiB
Architecture: aarch64
Beta Was this translation helpful? Give feedback.
All reactions