Tensor Core
1 article tagged with Tensor Core
November 17, 2026
researchNVIDIA
NVIDIA: Sparse attention indexer and Top-k take 47% of a DeepSeek V3.2 prefill layer at 128K tokens
NVIDIA published a co-design primer for model-level sparse attention. It reports that the indexer and Top-k take 47% of a DeepSeek V3.2 prefill layer at 128K tokens, and that reusing the prior decode step's selection speeds up Top-k by 2.1x to 2.4x.