Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[V1] Add code dataset to benchmark the performance of spec decode #14013

Closed
LiuXiaoxuanPKU opened this issue Feb 28, 2025 · 2 comments
Closed

[V1] Add code dataset to benchmark the performance of spec decode #14013

LiuXiaoxuanPKU opened this issue Feb 28, 2025 · 2 comments
Labels
feature request New feature or request

Comments

@LiuXiaoxuanPKU
Copy link
Collaborator

LiuXiaoxuanPKU commented Feb 28, 2025 •
edited
Loading

Current we don't have a code-related dataset in the benchmark. It will be nice to have a code editing dataset to demonstrate the major use case and benefits of ngram speculative decoding.
@LiuXiaoxuanPKU LiuXiaoxuanPKU added the feature request New feature or request label Feb 28, 2025
@CXIAAAAA CXIAAAAA mentioned this issue Feb 28, 2025
Closed
1 task
@ywang96 ywang96 moved this to Todo in Onboarding Tasks Mar 7, 2025
@CXIAAAAA
Copy link
Contributor

#15303 @LiuXiaoxuanPKU @WoosukKwon pls take a look

@CXIAAAAA
Copy link
Contributor

@LiuXiaoxuanPKU this is completed and we could mark it as done

@LiuXiaoxuanPKU LiuXiaoxuanPKU moved this from Todo to Done in Onboarding Tasks Mar 28, 2025
@LiuXiaoxuanPKU LiuXiaoxuanPKU closed this as completed by moving to Done in Onboarding Tasks Mar 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature request New feature or request
Projects
Onboarding Tasks
Status: Done
[V1] Speculative Decoding
Status: Done
Milestone
No milestone
Development

No branches or pull requests
2 participants
@LiuXiaoxuanPKU @CXIAAAAA