Include xgrammar as the default ebnf/json parser #11319
dhiaeddineTounekti
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello, I want to suggest adding xgrammar as structured output backend. It would greatly benefit structured output generation speed.
vllm enhancement with xgrammar
paper comparing llama.cpp to sglang with xgrammar
Beta Was this translation helpful? Give feedback.
All reactions