1bit engine

https://github.com/1bit-monster/engine

1bit engine is a model-agnostic C++ inference engine that runs inside Lemonade to serve LLMs behind...

Tokens:116,986
Snippets:612
Trust Score:5.2
License:Apache-2.0
Update:1 week ago
Tokens:
Raw