-
Notifications
You must be signed in to change notification settings - Fork 61
Support parallel tool calling #457
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
HELL YEAH Will convert vitals back to |
Still working on a more minimal reprex, but bringing this up before I need to hop into a couple meetings: It seems like the responses in the output are sometimes "scrambled" following uneven numbers tool calls. Here's a whittled down version of the vignette where this came up: library(ellmer)
library(btw)
# just for the `are` dataset
library(vitals)
ch <- chat_anthropic(model = "claude-3-7-sonnet-latest")
btw_register_tools(ch, tools = "docs")
res <- ch$chat_parallel(as.list(are$input[1:5])) For example, here's one chat transcript where the model tool calls for some relevant documentation, and then, in its response, provides an answer to a different question from the list of prompts:
I've also seen the opposite, where the initial prompt and the final answer line up, but some intermediate tool is completely unrelated and the model doesn't seem to have "seen" that it happened. |
@simonpcouch it's totally possible I've messed up the indexing |
Fixes #356
@simonpcouch can you please kick the tires a bit?