Qwen3.8-Flash-Next Released, Early Spoiler of Qwen4 Architecture
Alibaba's Qwen team open-sourced Qwen3.8-Flash-Next, a multimodal MoE model previewing Qwen4. It has a highly sparse MoE design with 125B parameters, plus a 51B N-gram embedding table and 4B multi-token prediction module, delivering superior performance at very low compute cost.....
15.0K
