vLLM Semantic Router

https://github.com/vllm-project/semantic-router

vLLM Semantic Router provides system-level intelligence for Mixture-of-Models (MoM) and LLM systems,...

Tokens:257,502
Snippets:3,476
Trust Score:6.7
License:Apache-2.0
Update:1 month ago
Tokens:
Raw