vLLM

https://github.com/vllm-project/vllm

vLLM is an easy, fast, and cheap LLM serving solution for everyone, offering significant speedups...

Tokens:2,105,311
Snippets:11,949
Trust Score:6.2
License:Apache-2.0
Update:1 week ago
Tokens:
Raw