SpargeAttention

https://github.com/thu-ml/spargeattn

SpargeAttention is a universal training-free sparse attention mechanism that accelerates language,...

Tokens:3,809
Snippets:45
Trust Score:9.8
License:Apache-2.0
Update:2 weeks ago
Tokens:
Raw