OpenAI-Compatible vLLM Serverless Endpoint Worker

https://github.com/runpod-workers/worker-vllm

A RunPod Serverless worker that deploys OpenAI-compatible, blazing-fast LLM endpoints powered by the...

Tokens:41,720
Snippets:415
Trust Score:9.1
License:MIT
Update:4 weeks ago
Tokens:
Raw