AutoAWQ

https://casper-hansen.github.io/AutoAWQ/

AutoAWQ is a quantization library that enables fast inference for large language models through...

Tokens:16,255
Snippets:73
Trust Score:9.7
Update:2 months ago
Tokens:
Raw