Cite
Notes
Only stored in your browser.
Attribution
TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training
arXiv 2024
PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
arXiv 2023
from 2 papers
Andrew Gu
Less Wright
Ajit Mathews
Alban Desmaison
Bernard Nguyen
Can Balioglu
Geeta Chauhan
Gokul Nadathur
Hamid Shojanazeri
Howard Huang