Cite
Notes
Only stored in your browser.
Attribution
SLoPe: Double-Pruned Sparse Plus Lazy Low-Rank Adapter Pretraining of LLMs
arXiv 2024
MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 Updates
mkor-momentum-enabled-kronecker-factor-based
from 2 papers
Maryam Mehri Dehnavi
Zhao Zhang
Amir Yazdanbakhsh
Sikan Li