We introduce Step 3.5 Flash, a sparse Mixture-of-Experts (MoE) model that bridges frontier-level agentic intelligence and computational efficiency. We focus on what matters most when building agents: sharp reasoning and fast, reliable execution. Step 3.5 Flash pairs a 196B-parameter foundation with 11B active parameters for efficient inference. It is optimized with interleaved 3:1 sliding-window/full attention and Multi-Token Prediction (MTP-3) to reduce the latency and cost of multi-round agentic interactions. To reach frontier-level intelligence, we design a scalable reinforcement learning framework that combines verifiable signals with preference feedback, while remaining stable under large-scale off-policy training, enabling consistent self-improvement across mathematics, code, and tool use. Step 3.5 Flash demonstrates strong performance across agent, coding, and math tasks, achieving 85.4% on IMO-AnswerBench, 86.4% on LiveCodeBench-v6 (2024.08-2025.05), 88.2% on tau2-Bench, 69.0% on BrowseComp (with context management), and 51.0% on Terminal-Bench 2.0, comparable to frontier models such as GPT-5.2 xHigh and Gemini 3.0 Pro. By redefining the efficiency frontier, Step 3.5 Flash provides a high-density foundation for deploying sophisticated agents in real-world industrial environments.
Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters
Step 3.5 Flash is a sparse Mixture-of-Experts model that achieves frontier-level agentic intelligence through efficient parameter utilization and optimized attention mechanisms, demonstrating strong performance across multiple benchmarks.
- Year
- 2026
- Venue
- arXiv 2026
- Stars
- 2.1k
- Authors
- 215
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/2602.10604ARXIV-DEFAULT
- TL;DR
- Semantic Scholar
Topics
2Abstract
Authors
215Daxin JiangLiangyu ChenXuan HeXin LiuBin WangPeng LiuAng LiJie zhouMingrui ChenLei YangNa WangLiang ZhaoYang LiChunrui HanGuopeng LiYuang PengQuan SunJingwei WuZheng GeYibo ZhuBinxing JiaoXiangyu ZhangJie YangFanqi WanMing LiYixuan ZhangXu ZhaoKaibo LiuYuzhu CaiWei zhangZhewei HuangHongYu ZhouHeung-Yeung ShumHeng WangJingyang ZhangZixuan WangBoYu ChenChen HuSiyu ChenJia WangYanming XuJianjian SunDi QiXin LiJingcheng HuYinmin ZhangQi HanZhe XieJie LuoTianhao ChengZhiheng HuAilin HuangHongyuan WangBo DongChang SuYu ZhouZhenyi LuSiye WuJie ChengZheng GongDan MaWei JiHangyu GuoZili WangChen XuZixin ZhangXinran WangWenzhen ZhengShiwei LiHanshan ZhangYuantao FanWen SunKangheng LinAobo KongYongchi ZhaoBojun WangBrian LiBuyun MaChangxin MiaoChangyi WanChao LouChenfeng YuChengting FengChengyuan YaoDapeng ShiDehua MaDeshan SunEnle LiuFajie ZhangGuanzhe HuangGulin YanGuoliang CaoHan ChengHao NieHaonan JiaHaoran LvHebin ZhouHekun LvHongbo HuangHongbo PengHouyong ChenHuangxi ZhuHuimin WuHuiyong GuoJian ZhouJiaoren WuJiaran ZhangJiashu LvJiashuo LiuJiayi FuJiayu LiuJieyi HouJing BaiJingJing XieJishi ZhouJunfeng LiuJunzhe LinKa Man LoKai LiangKaijun TanKaiwen YanKaixiang LiKang AnLiang LvLieyu ShiLiguo TanLin LinLina ChenLuck MaMengqiang RenMichael LiMingliang LiMingming ZhangMitt HuangQian ZhaoQinglin HeQinxin DuQiuping WuRongqiu YangRuihang MiaoRuixin HanRuosi WanRuyan GuoShan WangShaoliang PangShaowen YangShengjie FanShijie ShangShiliang YangShuangshuang TianSiQi LiuSong YuanTiancheng CaoTianchi YueTianning LiTingdan LuoWang YouWei YuanWeibo WuWeihao XieWenjin DengWuxun XieXiangfeng WangXiangwen KongXiangyu LiuXiaobo YangXiaojia LiuXiaolan YuanXiaoran JiaoXiaoxiao RenXiaoyun ZhangXin WuXing ChenXingping YangXuanti FengXuedan CaiXuqiang ZhouYanbo YuYang XuYanlin LaiYaoyu WangYeqing ShenYichen LvYicheng CaoYifeng GongYijing YangYikun YangYin ZhaoYingxiu ZhaoYitong ZhangYiyang ChenYongshen LongYongyao WangYousong GuanYuanhao DingYuanzhen YangYuchu LuoYudi ZhaoYue PengYueqiang LinYufan LuYuling ZhaoYunzhou JuYurong ZhangYusheng LiYuxiang YangYuyang ChenZejia WengZetao HongZexi LiZheng ZengZhichao ChangZhiguo HuangZidong YangZiqi Ren