TPSTokens Per Second

DeepSeek-V3.1: hardware requirements

DeepSeek-V3.1 needs about 416 GB of memory at Q4 quantization — a 405 GB download plus room for context and overhead. That is beyond consumer hardware; use it through an API instead.

Parameters
685B
Tier
Server only
Licence
See model card
Released
2025-08-21

Will it run on your machine?

8GB RAMNot enough memory16GB RAMNot enough memory32GB RAMNot enough memory64GB RAMNot enough memory128GB RAMNot enough memory8GB VRAMNot enough memory12GB VRAMNot enough memory16GB VRAMNot enough memory24GB VRAMNot enough memory32GB VRAMNot enough memory

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Q4_K_Mrecommended405 GB416 GB466 GBmeasured
Q5_K_M476 GB487 GB537 GBmeasured
Q6_K551 GB562 GB612 GBmeasured
Q8_0713 GB724 GB774 GBmeasured
BF161342 GB1353 GB1403 GBmeasured

“Measured” sizes are read from published GGUF files (unsloth/DeepSeek-V3.1-GGUF). “Estimated” sizes are derived from the parameter count and are typically within a few percent. The RAM columns add the context cache and runtime overhead to the download size.

Model card on HuggingFace →API specs & pricing →Verified 2026-08-01