Physical AI needs to be trained digitally first. It needs a digital twin of itself, the policy model, and a digital twin of the world, the world model. In this paper, we present the Cosmos World Foundation Model Platform to help developers build customized world models for their Physical AI setups. We position a world foundation model as a general-purpose world model that can be fine-tuned into customized world models for downstream applications. Our platform covers a video curation pipeline, pre-trained world foundation models, examples of post-training of pre-trained world foundation models, and video tokenizers. To help Physical AI builders solve the most critical problems of our society, we make Cosmos open-source and our models open-weight with permissive licenses available via https://github.com/nvidia-cosmos/cosmos-predict1.
Cosmos World Foundation Model Platform for Physical AI
Physical AI needs to be trained digitally first.
- Year
- 2025
- Venue
- arXiv 2025
- Authors
- 78
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/2501.03575v2ARXIV-DEFAULT
- TL;DR
- Semantic Scholar
Abstract
Authors
78NVIDIAYuxuan ZhangJing ZhangHao WangQianli MaDieter FoxZhaoshuo LiJiashu XuMing-Yu LiuYin CuiTsung-Yi LinFangyin WeiHanzi MaoJay Zhangjie WuSeung Wook KimLaura Leal-TaixeSanja FidlerHuan LingYunhao GeJiahui HuangTing-Chun WangXiaohui ZengHeng WangXiaowei RenZeeshan PatelEthan HeNiket AgarwalJacob HuffmanVasanth Rao Naik SabavatSriharsha NivertyDavid PageFitsum RedaPrithvijit ChattopadhyayYifan DingFrancesco FerroniJinwei GuSiddharth GururaniJingyi JinAlice LuoLindsey PavaoLyne TchapmiHaoxiang WangQinsheng ZhangYu ZengMaciej BalaTiffany CaiPooya JannatyShiyi LanXian LiuShitao TangArslan AliYogesh BalajiErik BarkerYongxin ChenDaniel DworakowskiJiaojiao FanMichele FenziSongwei GeGergely KlárGrace LamAnqi LiChen-Hsuan LinKaichun MoArsalan MousavianSeungjun NahDespoina PaschalidouMorteza RamezanaliEd SchmerlingStella ShiBartosz StefaniakPrzemek TredakWei-Cheng TsengJibin VargheseXinyue WeiWei YangLin Yen-ChenQingqing ZhaoArtur Zolkowski