vLLM Production Stack

https://github.com/vllm-project/production-stack

A reference implementation for deploying vLLM in production, enabling scalable distributed...

Tokens:122,796
Snippets:1,453
Trust Score:6.2
License:Apache-2.0
Update:1 week ago
Tokens:
Raw