Skip to content

Enable GPTQv2 from gptqmodel #134

Open
@chichun-charlie-liu

Description

@chichun-charlie-liu

Is your feature request related to a problem? Please describe.

GPTQv2 (aka GPTAQ) is supported by gptqmodel, we just need to add a flag to trigger it.

Describe the solution you'd like

add a flag and some description in GPTQ example README.MD

Additional context

GPTAQ may help the accuracy for some models, could be handy when needed.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions