量化微调的时候如果用flashAttention则报错 #201

Open

opened

on May 29, 2024

RuntimeError：FLashAttention only surpport fp16 and bf16 data type

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests