[Bug] Parallel sampling: The new token after prefill is duplicated for all generations #161

Open

Open

[Bug] Parallel sampling: The new token after prefill is duplicated for all generations#161

Assignees

Labels

zxybazh#3 (comment)

Metadata

Assignees

masahi

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests