Aphrodite Engine

https://github.com/dphnai/aphrodite-engine

Aphrodite Engine is an inference engine that optimizes the serving of HuggingFace-compatible models...

Tokens:103,186
Snippets:1,075
Trust Score:5.6
Update:4 days ago
Tokens:
Raw