MegaBlocks

https://github.com/databricks/megablocks

MegaBlocks is a lightweight library for efficient mixture-of-experts (MoE) training with...

Tokens:8,899
Snippets:99
Trust Score:8.9
License:Apache-2.0
Update:4 weeks ago
Tokens:
Raw