Qwen 3.5 27B on RTX 5090 with vLLM NVFP4

https://github.com/aliez-ren/vllm-qwen3.5-nvfp4-sm120

A Docker-based setup for running the Qwen 3.5 27B language model on NVIDIA RTX 5090 using vLLM with...

Tokens:6,361
Snippets:49
Trust Score:9.3
Update:1 month ago
Tokens:
Raw