GuideLLM

https://github.com/vllm-project/guidellm

GuideLLM is an SLO-aware benchmarking and evaluation platform designed to optimize real-world LLM...

Tokens:38,480
Snippets:566
Trust Score:6.7
License:Apache-2.0
Update:1 week ago
Tokens:
Raw