TorchSpec

https://github.com/lightseekorg/torchspec

TorchSpec is a PyTorch-native speculative decoding training framework that disaggregates inference...

Tokens:19,054
Snippets:268
Trust Score:8
License:MIT
Update:2 weeks ago
Tokens:
Raw