MegaBlocks

https://github.com/databricks/megablocks

MegaBlocks is a lightweight library for efficient mixture-of-experts (MoE) training with...

Tokens:66,534
Snippets:490
Trust Score:8.9
License:Apache-2.0
Update:8 hours ago
Tokens:
Raw