Support AutoAWQ

[davidmezzetti]

Feature request

With AutoAWQ now being deprecated, would Hugging Face consider continuing support for this library? I've found this library to be the best way to run quantized models with Transformers.

Motivation

The motivation is being able to continue running quantized models via Transformers. I've found AWQ models to be the best option historically.

Your contribution

I've seen this fix and considered forking the repo to make it myself but it feels like Transformers would be the better place with this given the fairly involved integration.

[Rocketknight1]

cc @MekkCyber

[MekkCyber]

Hi @davidmezzetti, we are indeed continuing the support for loading AutoAWQ models, and we continue to fix issues related to awq

[davidmezzetti]

Got it, thank you for confirming.

What about this change? It seems like this should be done in a successor package to autoawq?