Devstral-2-123B-Instruct-2512: hardware requirements
Devstral-2-123B-Instruct-2512 needs about 80 GB of memory at Q4 quantization — a 75 GB download plus room for context and overhead. That fits a machine with 128GB RAM.
Parameters
125B
Tier
Needs a workstation
Licence
See model card
Released
2026-06-18
Will it run on your machine?
8GB RAMNot enough memory16GB RAMNot enough memory32GB RAMNot enough memory64GB RAMNot enough memory128GB RAMRuns well8GB VRAMNot enough memory12GB VRAMNot enough memory16GB VRAMNot enough memory24GB VRAMNot enough memory32GB VRAMNot enough memory
Download sizes by quantization
Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?
| Quant | Download | RAM @ 4K | RAM @ 32K | Source |
|---|---|---|---|---|
| Q4_K_Mrecommended | 75 GB | 80 GB | 90 GB | measured |
| Q5_K_M | 88 GB | 93 GB | 103 GB | measured |
| Q6_K | 103 GB | 107 GB | 118 GB | measured |
| Q8_0 | 133 GB | 138 GB | 148 GB | measured |
| BF16 | 250 GB | 255 GB | 265 GB | measured |
“Measured” sizes are read from published GGUF files (unsloth/Devstral-2-123B-Instruct-2512-GGUF). “Estimated” sizes are derived from the parameter count and are typically within a few percent. The RAM columns add the context cache and runtime overhead to the download size.