KTransformers

https://github.com/kvcache-ai/ktransformers

KTransformers is a flexible framework for efficient LLM inference and fine-tuning through CPU-GPU...

Tokens:105,595
Snippets:1,100
Trust Score:6.5
License:Apache-2.0
Update:1 month ago
Tokens:
Raw