LLMPerf

https://github.com/ray-project/llmperf

LLMPerf is a framework for evaluating LLM API performance through load testing and correctness...

Tokens:8,371
Snippets:70
Trust Score:-
License:Apache-2.0
Update:2 months ago
Tokens:
Raw