We present Nemotron 3 Nano 30B-A3B, a Mixture-of-Experts hybrid Mamba-Transformer language model. Nemotron 3 Nano was pretrained on 25 trillion text tokens, including more than 3 trillion new unique tokens over Nemotron 2, followed by supervised fine tuning and large-scale RL on diverse environments. Nemotron 3 Nano achieves better accuracy than our previous generation Nemotron 2 Nano while activating less than half of the parameters per forward pass. It achieves up to 3.3x higher inference throughput than similarly-sized open models like GPT-OSS-20B and Qwen3-30B-A3B-Thinking-2507, while also being more accurate on popular benchmarks. Nemotron 3 Nano demonstrates enhanced agentic, reasoning, and chat abilities and supports context lengths up to 1M tokens. We release both our pretrained Nemotron 3 Nano 30B-A3B Base and post-trained Nemotron 3 Nano 30B-A3B checkpoints on Hugging Face.
Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
We present Nemotron 3 Nano 30B-A3B, a Mixture-of-Experts hybrid Mamba-Transformer language model.
- Year
- 2025
- Venue
- arXiv 2025
- Stars
- 1.2k
- Authors
- 313
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/2512.20848ARXIV-DEFAULT
- TL;DR
- Semantic Scholar
Topics
1Abstract
Authors
313Alisa LiuBanghua ZhuBryan CatanzaroGerald ShenJian ZhangJiaqi ZengJimmy ZhangMakesh Narsimhan SreedharNVIDIAOleksii KuchaievOlivier DelalleauYejin ChoiJan KautzPavlo MolchanovMaor AshkenaziBita Darvish RouhaniRan ZilbersteinYonatan GeifmanRoger WaleffeDuncan RiachBrandon NorickVijay KorthikantiDeepak NarayananJared CasperMohammad ShoeybiLeon DerczynskiErick GalinkinSahil ModiEdward LinAkhiad BercovichRan El-YanivZach MosheIdo ShahafSoumye SinghalAlexander BukharinYian ZhangTugrul KonukAmeya Sunil MahabaleshwarkarBilal KartalYoshi SuharaZijia ChenDavid MosallanezhadAdi RenduchintalaHaifeng QianDima RekeshFei JiaSomshubra MajumdarVahid NorooziWasi Uddin AhmadSean NarenthiranAleksander FicekMehrzad SamadiIgor GitmanIvan MoshkovWei DuShubham ToshniwalGeorge ArmstrongBranislav KisacaninMatvei NovikovDaria GitmanEvelina BakhturinaJane Polak ScowcroftJohn KamaluDan SuKezhi KongMarkus KlieglYing LinSanjeev SatheeshJupinder ParmarPritam GundechaJoseph JenningsShrimai PrabhumoyeSyeda Nahida AkterMostofa PatwaryAbhinav KhattarTerry KongParth ChadhaJining HuangSergey KashirskyIzzy PuttermanManoj KilaruNave AssafShahar MorOmer Ullman ArgovAnahita BhiwandiwallaSmita IthapeJoyjit DawMichael EvansShaona GhoshKatherine LunaNikki PopeEileen LongChris AlexiukJoey ConwayAnn GuanKrzysztof PawelecBoris GinsburgOluwatobi OlabiyiKari BriskiJonathan CohenEric ChungWanli JiangChristopher ParisienMike ChrzanowskiRyan PrengerBenedikt SchiffererZhen DongChenghao ZhangAndrew TaoWei PingHuizi MaoCheng-Ping HsiehSimeng SunSamuel KrimanShantanu AcharyaAaron BlakemanAaron GrattafioriAarti BasantAbhibha GuptaAditya VavreAkanksha ShuklaAleksandr ShaposhnikovAlex KondratenkoAlexandre MilesiAli TaghibakhshiAmelia BartonAmir KleinAmit ZukerAmnon GeifmanAmy ShenAnubhav MandarwalArham MehtaAshwath AithalAshwin PoojaryAsif AhamedAsma Kuriparambil ThekkumpateAyush DattaguptaBardiya SadeghiBarnaby SimkinBen LanirBesmira NushiBrandon SoubasisBrian YuCarlo del MundoChantal HwangCharles WangChenhan YuChetan MungekarChintan PatelCollin NealeDamon Mosk-AoyamaDane CorneilDaniel AfrimiDaniel RohrerDaniel SerebrenikDaria LevyDarko StosicDhruv NathawaniDina YaredDivyanshu KakwaniDong AhnDusan StosicEdgar MinasyanEileen Peters LongElena LantzEllie EvansElliott NingEric HarperEric TramelErik PoundsEvan BrionesFaisal LadhakFay WangFelipe SoaresFeng ChenFerenc GalkoFrankie SiinoGal Hubara AgamGanesh AjjanagaddeGantavya BhattGargi PrasadGorkem BatmazGrigor NalbandyanHarsh SharmaHayley RossHelen NgoHerman SahotaHexin WangHimanshu SoniHiren UpadhyayHuy C NguyenHuy Q NguyenIain CunninghamIlya LoshchilovJatin MitraJeffrey GlickJenny ChenJesse OliverJie LouJoey GumanJohnny GrecoJulien Veron VialardJunkeun YiKai XuKan ZhuKatherine CheungKeshav SanthanamKevin ShihKhushi BhardwajKrishna C. PuvvadaKumar AnikLawrence McAfeeLaya SleimanLi DingLucas LiebenweinLuis VegaMaanu GroverMaarten Van SegbroeckMaer Rodrigues de MeloMarc RomeijnMark CaiMaryam MoosaeiMelissa CorpuzMengru WangMeredith PriceMichael BooneMiguel MartinezNabin MulepatiNatalie HerethNegar HabibiNeta ZmoraNetanel HaberNicola SessionsNidhi BhatiaNikhil JukarNikolai LudwigNima TajbakhshNirmal JuluruOleksii HrinchukOuye XiePasha ShamisPawel MorkiszPeter DykasPeter JinPinky XuPiotr JanuszewskiPranav Prashant ThombrePrasoon VarshneyQing MiaoRabeeh Karimi MahabadiRasoul ShafipourRich HarangRick IzzoRima ShahbazyanRishabh GargRitika BorkarRitu GalaRiyad IslamRohit WatveRoi KorenRuoxi ZhangRussell J. HewettRyan TimbrookSadegh MahdaviSanjay KariyappaSaori KajiSatish PasumarthiSean NarentharenSeonmyeong BakSeth PoulosShanmugam RamasamySharath Turuvekere SreenivasShelby ThomasShiqing FanShreya GopalShubham PachoriShuoyang DingSiddharth SinghStefania AlborghettiStephen GeSugam Dipak DevareSumeet Kumar BaruaSuseella PanguluriSuyog GuptaSweta PriyadarshiTan BuiTeodor-Dumitru EneThanh DoTijmen BlankevoortTom BaloughTomer AsidaTomer Bar NatanTwinkle VashishthUdi KarpasUshnish DeVahid NooroziVenkat SrinivasanVenmugil ElangoVitaly KurinVitaly LavrukhinWenfei ZhouWill JenningsWilliam ZhangWojciech PrazuchXiaowei RenYashaswi KarnatiYev MeyerYi-Fu WuYonggan FuYoshi SubaraYubo GaoZihan LiuZijie Yan