Skip to content

paged_adamw_8bit优化支持 #7595

@zhangtianhong-1998

Description

@zhangtianhong-1998

Reminder

  • I have read the above rules and searched the existing issues.

Description

在Open-R1最新的repo使用,fsdp和paged_adamw_8bit优化可以节省一定显存扩展上下文,不知道LLaMa-Factory是否有对应计划

Pull Request

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    solvedThis problem has been already solved

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions