Mixture of Attention

https://github.com/lucidrains/mixture-of-attention

Mixture of Attention is a PyTorch implementation that routes tokens to different autoregressive...

Tokens:5,536
Snippets:44
Trust Score:9.9
License:MIT
Update:2 months ago
Tokens:
Raw