On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability
31 Aug 2026
We describe the architecture and ablations of Qwen3.8-Flash-Next, a sparse mixture-of-experts model with 125B parameters, 6B activated per token, and additional 51B parameters of n-gram embedding tables held off the accelerator.