Cite
Notes
Only stored in your browser.
Attribution
SOAP: Improving and Stabilizing Shampoo using Adam
arXiv 2024
How Does Critical Batch Size Scale in Pre-training?
from 2 papers
Nikhil Vyas
Sham Kakade
David Brandfonbrener
Dean Foster
Difan Zou
HANLIN ZHANG
Itai Shapira
Jingfeng Wu
Lucas Janson
Mujin Kwun