Skip to content

NVMLError_NoPermission: Insufficient Permissions #106

Open
@sz2three

Description

@sz2three

when use python quant_infer.py --wbits 2 --load pyllama-7B8b.pt --text "..." --max_length 24 , it raises error
NVMLError_NoPermission: Insufficient Permissions

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions