HeavyBall

https://github.com/homebrewml/heavyball

A compile-first PyTorch optimizer library featuring AdamW, Muon, SOAP/Shampoo, PSGD, Schedule-Free,...

Tokens:3,799
Snippets:58
Trust Score:6.9
License:BSD-2-Clause
Update:1 month ago
Tokens:
Raw