ExLlamaV3

https://github.com/turboderp-org/exllamav3

ExLlamaV3 is an inference library for running local large language models on consumer GPUs with...

Tokens:17,203
Snippets:249
Trust Score:5.9
License:MIT
Update:2 months ago
Tokens:
Raw