Alibaba Qwen · MoE Architecture

Qwen3.8-2.4T-A95B (open weights)

The open weights promised when Qwen3.8-Max launched last week. 2.4T total, 95B active, 92 layers built as 23 cycles of three Gated DeltaNet MoE blocks to one Gated Attention MoE block. Context is 262,144 native, extensible to 1,010,000. Scores 92.6 on GPQA Diamond, 86.6 on Terminal-Bench 2.1 and 67.7% on SWE-bench Pro. Thinking mode is mandatory.

Open the source ↗

Similar Language Models releases

More from Alibaba Qwen

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.