Goinfer is an inference proxy that allows swapping between multiple *.gguf models on remote machines...

Tokens:19,471
Snippets:203
Trust Score:6.3
License:MIT
Update:2 weeks ago
Tokens:
Raw