Ring Attention Pytorch

https://github.com/lucidrains/ring-attention-pytorch

Ring Attention Pytorch is a PyTorch implementation of Ring Attention that distributes data across...

Tokens:4,501
Snippets:36
Trust Score:9.9
License:MIT
Update:2 months ago
Tokens:
Raw