关闭vllm功能时的多gpu并行推理问题 #51

Open

Open

关闭vllm功能时的多gpu并行推理问题#51

在关闭vllm功能后，正常设置多gpu推理会出现tensors所在的device不统一的问题

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests