We introduce Ling 2.0, a series reasoning-oriented language foundation built upon the principle that every activation boosts reasoning capability. Designed to scale from tens of billions to one trillion parameters under a unified Mixture-of-Experts (MoE) paradigm, Ling 2.0 emphasizes high sparsity, cross-scale consistency, and efficiency guided by empirical scaling laws. The series includes three non-thinking (instruct) models - Ling-mini-2.0, Ling-flash-2.0, and Ling-1T - ranging from 16B to 1T total parameters and achieving up to 7-fold active-compute efficiency compared with dense counterparts. Ling 2.0 integrates coordinated innovations across model architecture, pre-training, post-training, and infrastructure: a high-sparsity MoE with MTP for efficient reasoning, reasoning-oriented data and mid-training CoT activation, reinforcement-based fine-tuning (DFT, Evo-CoT), and full-scale FP8 training with fine-grained heterogeneous pipelines. At the trillion scale, Ling-1T establishes a new Pareto frontier of reasoning accuracy versus computational efficiency, demonstrating that sparse activation, when properly aligned with reasoning objectives, enables scalable and efficient intelligence. Collectively, Ling 2.0 provides a coherent, open, and efficient foundation for advancing future reasoning and thinking models, including the Ring series built upon the same base.
Every Activation Boosted: Scaling General Reasoner to 1 Trillion Open Language Foundation
Ling 2.0, a reasoning-oriented language model series, achieves high efficiency and accuracy through a Mixture-of-Experts paradigm, sparse activation, and innovative training techniques.
- Year
- 2025
- Venue
- arXiv 2025
- Authors
- 141
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/2510.22115ARXIV-DEFAULT
- TL;DR
- Semantic Scholar
Abstract
Authors
141Jia LiChao HuangAng LiShuo ZhangChao ZhangJiaolong YangSiyuan LiXingyu LuLei XuYue YuChen QianLei LiangLing ZhongPeilong ZhaoLin YuanJun XuZhiqiang ZhangJun ZhouSong LiuYue YangTong ZhaoLintao MaYang XiangJun LiuYun ZhangXiaolu ZhangYuqi ZhangWeiguang HanShijie LianYi ZhangZhihao WangZiqi LiuPeijie JiangJia LiuXudong WangXiang ShuZhaoyang WangBen LiuMin ChenBing LiLibo ZhangYuanyuan WangFeng ZhuJingyuan ZhangCunyin PengLu LiuXin ZhaoQian ZhaoYajie YangLing TeamXuemin YangYilong WangYongzhen GuoCong ZhangMinghong CaiBinbin HuBingwei ZengBorui YeCaizhi TangChangxin TianChenchen JuChenchen LiChengfu TangChili FuChunshao RenChunwei WuDafeng XuDaixin WangDalong Zhangdingnan jinDingyuan ZhuDongke HuFangzheng ZhaoFeifan WuGangshan WangHaiTao ZhangHailin ZhaoHanxiao ZhangHanzi WangHao QianHaoyi YuHeng ZhangHongliang ZhangHongzhi LuanHuirong DongHuizhong LiJialong ZhuJian ShaJianping WeiJieyue MaJiewei WuJinjing HuangJingyun TianJinquan SunJuanhui TuJunjie OuJunpeng FangKaihong ZhangKaiqin HuKe ShiKun TangKunlong ChenLanyin MeiLin JuLu YuLun CaiMeiqi ZhuMengying LiMinghao XueMingming YinPingping LiuQing CuiQingxiang HuangQingyuan YangQuankun YuShaowei WeiShoujian ZhengShun SongShungen ZhangTing GuoWanli GuWeichang WuWenjing FangWubin WangXiao ShiXiaoshun LanXiaqing SunXiong XuYanzhe LiYingxue LiYuzhuo FuYufeng DengYunfei XuYuxiao HeZengke GuiZhaoXin HuanZhibo ZhuZhoufei WangZihang ZengZitao XuanZuoli Tang