Skip to content

2.0.0

Choose a tag to compare

View all tags
@TimPietruskyRunPod TimPietruskyRunPod released this 03 Nov 15:38
· 2 commits to main since this release
1.3.0
78dcd24
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
  • feat: added tool_call_parser; updated sglang to 0.5.2
  • feat: use "MODEL_NAME" instead of "MODEL_PATH"

breaking changes

  • MODEL_PATH → MODEL_NAME to use the same naming as worker-vllm
  • CUDA 12.6 minimum (was 12.4)
Assets 2
Loading