GPT-QModel

https://github.com/modelcloud/gptqmodel

GPT-QModel is an LLM model quantization and compression toolkit with hardware-accelerated inference...

Tokens:25,113
Snippets:294
Trust Score:6.2
License:Apache-2.0
Update:4 days ago
Tokens:
Raw