MoE
1 article tagged with MoE
April 16, 2026
model release+1
Alibaba Releases Qwen3.6-35B-A3B: 35B Parameter MoE Model with 262K Context Window
Alibaba has released Qwen3.6-35B-A3B, the first open-weight model in the Qwen3.6 series. The model features 35B total parameters with 3B activated, a native 262K context window extensible to 1.01M tokens, and achieves 73.4% on SWE-bench Verified using 256 experts with 8 activated per token.