model releaseDeepSeek

DeepSeek Releases V4.1-Flash: 552B MoE Model Cuts KV Cache to 890 Bytes Per Token

TL;DR

DeepSeek has released V4.1-Flash, a 552B-parameter multimodal Mixture-of-Experts model supporting 1M-token context and activating only 8B parameters during prefill. The model uses a new Causal Encoder-Decoder architecture and Compressed Sparse Attention 2 to cut global KV cache to 890 bytes per token, roughly a quarter of its predecessor.

3 min read
0

DeepSeek-V4.1-Flash at a glance

Context window1049K tokens
Input$0.0498/1M tokens
Output$0.1992/1M tokens

How DeepSeek-V4.1-Flash ranks now

BenchmarkScoreRankSource
GPQA90.9%38 of 165Hugging Face model card ↗
Speed (tok/s)217 tok/s12 of 105Artificial Analysis, Nov 2026 ↗
Hallucination (Summarization) (lower is better)4.2%3 of 49Vectara, Nov 2026 ↗

Rank is against every model in our database with a sourced score on that benchmark, each counted once with its best score.

All DeepSeek-V4.1-Flash specs and scores →

DeepSeek AI has released DeepSeek-V4.1-Flash, a 552-billion-parameter multimodal Mixture-of-Experts model that supports context windows up to 1 million tokens while activating only 8 billion parameters during prefill and 16 billion during decode, according to the company's technical report published on Hugging Face.

The model is built on what DeepSeek calls a Causal Encoder-Decoder (CED) architecture: a 40-layer Transformer split into a 20-layer causal encoder and a 20-layer decoder, where the decoder's global KV cache is projected from the encoder's final hidden states rather than computed independently per layer. Combined with a technique DeepSeek calls SWA Bounded Replay and Compressed Sparse Attention 2 (CSA2), the architecture reduces the persistent KV cache footprint to roughly one-eighth of DeepSeek-V4-Flash's, and the global KV cache to 890 bytes per token — about a quarter of the prior generation, according to DeepSeek. The company claims this represents a 437-fold reduction versus DeepSeek-V1.

The MoE layer uses 1 shared expert and 384 routed experts, activating 6 routed experts per token. Additional components include FP4 main KV caching, a 196B-parameter "Engram" conditional memory module accessed via sparse token-based lookup, and DSpark speculative decoding for semi-autoregressive draft generation.

On the multimodal side, DeepSeek pairs a from-scratch vision encoder (DeepSeek-ViT, using 2D-RoPE and 3×3 pixel-unshuffle downsampling) with a two-layer MLP projector, trained jointly with text from the start of pre-training. Pre-training covered 45 trillion multimodal tokens, with sparse attention trained at 64K sequence length before context was extended to 1M tokens over an additional 34T tokens.

The instruct model supports a continuously controllable "reasoning effort" parameter from 1 to 100, trading inference cost for accuracy. At maximum effort, DeepSeek-V4.1-Flash scored 90.9 on GPQA Diamond, 36.8 on HLE (39.1 on the text-only subset), and a Codeforces rating of 3471 — the highest reported among the comparison set that included Opus-5.0, GPT-5.6, Sol K3, and GLM-5.3, according to DeepSeek's own benchmark table.

On agentic coding benchmarks, DeepSeek reports V4.1-Flash outperforming GPT-5.6 on Terminal Bench 2.1 (90.6 vs. 88.8) and DeepSWE v1.1 (74.2 vs. 73.0 resolved), though it trails on Terminal Bench 3.0 and 4.0 (30.0 and 31.2, versus GPT-5.6's 43.3 and 39.9). Multimodal evaluations include 56.5 on MMMU-Pro, 77.9 on CVBench, and 95.6 on DocVQA (LLM-Judge).

DeepSeek has not published pricing for the model. The release does not include a Jinja chat template; instead, the company provides a Python reference implementation and a Rust-based toolkit called deepseek-recipe for encoding prompts and parsing outputs across Messages, Chat Completions, and Responses API formats.

What this means

DeepSeek's KV cache engineering is the headline story here, not raw parameter count. An 890-byte-per-token footprint at 1M-token context makes long-context agentic workloads — the kind that involve extensive tool use and terminal sessions — dramatically cheaper to serve than dense-cache architectures. The benchmark spread is telling: V4.1-Flash beats larger frontier models on some agentic and coding tasks (Terminal Bench 2.1, DeepSWE, CyberGym) while trailing on others (Terminal Bench 3.0/4.0, MATH, MGSM), suggesting the architecture trades some raw reasoning ceiling for inference efficiency at scale. Independent verification of these self-reported benchmarks, and real-world pricing once available, will determine whether this becomes the default choice for cost-sensitive agentic deployments.

Related Articles

model release

Tencent releases Hy4 flagship weights: 770B-parameter MoE, 1,048,576-token context, conditional license

Tencent released downloadable weights for its flagship Hy4 on November 20, with a System Card. The multimodal MoE has a 770-billion-parameter language backbone, 49 billion active parameters per text token and a 1,048,576-token context window, under a license with commercial conditions for model-as-a-service operators.

model release

Tencent releases Hy4 flash: 220B MoE, 12B active parameters, 1M-token context

Tencent has released Hy4 flash, a multimodal Mixture-of-Experts model with 220B total parameters, 12B active per token, and a 1,048,576-token context window. Tencent calls it its most cost-effective Hy model to date and claims a per-task cost of 1/20 that of Hy4 on its internal WorkIndex benchmark.

model release

Thinking Machines Lab releases Inkling 2 Mini: 26B-parameter looped MoE with 3B active and 1M-token context

Thinking Machines Lab has released Inkling 2 Mini, a multimodal Mixture-of-Experts model with about 26B physical total parameters and 3B active per token. It repeats its middle layers three times, supports a 1M-token context, and ships with a DSpark drafter. Hugging Face reports it leads 32 of 48 benchmarks against four comparable models.

model release

Paradigm Intelligence launches Phai-A1 language model and Phai-M1 video model, trained on Huawei Ascend

Paradigm Intelligence (范式智能, formerly 第四范式) has unveiled two in-house models: Phai-A1, a language model that runs on a single RTX 3090, and Phai-M1, a video model with synchronized audio. The company says both were trained on Huawei Ascend hardware, with open weights coming soon.

Comments

Loading...