sardeenz

https://github.com/rh-aiservices-bu/sardeenz

A multi-model management platform built on vLLM and kvcached for efficient hosting and serving of...

Tokens:274,722
Snippets:2,713
Trust Score:9.4
License:Apache-2.0
Update:3 weeks ago
Tokens:
Raw