OptiLLM

https://github.com/algorithmicsuperintelligence/optillm

OptiLLM is an OpenAI API-compatible optimizing inference proxy that implements 20+ state-of-the-art...

Tokens:85,301
Snippets:1,636
Trust Score:7.3
License:Apache-2.0
Update:2 weeks ago
Tokens:
Raw