vLLM LLM Compressor

https://github.com/vllm-project/llm-compressor

LLM Compressor is a library for optimizing models for deployment with vLLM, offering quantization...

Tokens:55,050
Snippets:642
Trust Score:6.2
License:Apache-2.0
Update:4 weeks ago
Tokens:
Raw