Qwen Releases Qwen3.8 2.4T A95B, a 2.4-Trillion-Parameter Open-Weight MoE Model
Qwen has released Qwen3.8 2.4T A95B, an open-weight sparse mixture-of-experts model with 2.4 trillion total parameters and 95 billion active parameters per forward pass. The model is the open-weight variant of Qwen3.8 Max, targeting coding, research, complex reasoning, and agentic workflows with a 262K token context window.
Qwen Ships Open-Weight Variant of Qwen3.8 Max
Qwen has released Qwen3.8 2.4T A95B, a sparse mixture-of-experts (MoE) model with 2.4 trillion total parameters and 95 billion active parameters per inference pass. According to Qwen, this is the open-weight version of Qwen3.8 Max, the company's flagship closed model, and is designed for coding, research, complex reasoning, and agentic workflows.
The model is listed on OpenRouter with a 262,000-token context window and API pricing of $2 per 1M input tokens and $6 per 1M output tokens. The listing shows a release date of August 12, 2026.
Architecture
The headline figures — 2.4 trillion total parameters with only 95 billion active — put Qwen3.8 2.4T A95B among the largest MoE models disclosed to date by total parameter count, while keeping per-token compute closer to a mid-sized dense model through sparse expert routing. This design allows the model to draw on a much larger parameter pool for capacity while activating only a fraction of it (roughly 4%) for any given token, which is standard practice for MoE architectures used to balance quality against inference cost.
No benchmark scores, training data cutoff, or license details were included in the source listing. Qwen has not yet published a technical report, model card, or independent benchmark results for this release, so all architectural claims — including the total and active parameter counts — currently rest on Qwen's own listing rather than third-party verification.
What's confirmed vs. unconfirmed
Confirmed from the listing: total parameters (2.4T), active parameters (95B), context window (262K tokens), and API pricing ($2/$6 per 1M tokens). Unconfirmed: benchmark performance, training cutoff date, exact license terms, and whether the "open-weight" designation includes full weight downloads or a restricted release. Qwen describes this as the open-weight counterpart to a closed Qwen3.8 Max model, but no separate announcement for Qwen3.8 Max itself was available at time of writing.
What this means
A 2.4-trillion-parameter open-weight release, if the figures hold up under independent testing, would represent one of the largest total-parameter open models available for download and self-hosting, following the industry trend of decoupling total capacity from active compute via MoE routing. The lack of published benchmarks makes it impossible to assess how the model performs against comparable systems like DeepSeek V3, Llama 4, or Mistral's largest offerings. Practically, running a model with 2.4T total parameters — even with sparse activation — requires substantial memory and infrastructure for self-hosting, meaning most users will access it through API pricing at $2/$6 per 1M tokens rather than local deployment. Until Qwen publishes a technical report with verified benchmark scores and training details, the model's real-world capabilities relative to its scale remain an open question.
Related Articles
NVIDIA Releases Nemotron 3.5 Lightning: 30B MoE Model with 1M Token Context and 3B Active Parameters
NVIDIA released the full-precision BF16 reference weights for Nemotron 3.5 Lightning, a 30B-parameter Mixture-of-Experts model with only 3B active parameters and support for up to 1 million tokens of context. The model uses a hybrid Mamba-2, MoE, and Attention architecture and is licensed under OpenMDW-1.1 for commercial use.
Alibaba Releases Qwen3.8, a 2.4T-Parameter MoE Model with 262K Native Context
Alibaba's Qwen team has released Qwen3.8-2.4T-A95B, a 2.4-trillion-parameter mixture-of-experts model activating 95B parameters per token. The company claims it is the first open-weight release to reach Qwen-Max-class performance, with a hosted variant, Qwen3.8-Max, offering 1M-token context and vision input.
DeepSeek Releases V4 Pro 0813 With 1.05M Token Context Window, Priced at $0.43/M Input
DeepSeek has shipped the general availability release of DeepSeek V4 Pro, codenamed 0813, featuring a 1,049,000-token context window. The mixture-of-experts model is priced at $0.43 per million input tokens and $0.87 per million output tokens, and is live now on OpenRouter.
NVIDIA Releases Nemotron 3.5 Lightning 30B-A3B: 3B-Active MoE Model With 1M-Token Context, Quantized for Single-GPU Depl
NVIDIA has published NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4, a 30-billion-parameter Mixture-of-Experts model with only 3B active parameters, a hybrid Mamba-2/MoE/Attention architecture, and support for up to 1 million tokens of context. The NVFP4-quantized checkpoint is designed to run on a single DGX Spark (GB10) or H100 GPU.
Comments
Loading...