AutoAWQ

github.com ↗

- AutoAWQ is an easy-to-use package for 4-bit quantized models.