Ministral-3-8B-Instruct-2512: hardware requirements

Ministral-3-8B-Instruct-2512 needs about 6.3 GB of memory at Q4 quantization — a 5.2 GB download plus room for context and overhead. That fits a machine with 16GB RAM.

Parameters
8.9B
Tier
Runs on a laptop
Licence
apache-2.0
Released
2025-10-31

Will it run on your machine?

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Q4_K_Mrecommended5.2 GB6.3 GB10 GBmeasured
Q5_K_M6.1 GB7.2 GB11 GBmeasured
Q6_K7.0 GB8.2 GB12 GBmeasured
Q8_09.0 GB11 GB14 GBmeasured
BF1618 GB20 GB24 GBmeasured

“Measured” sizes are read from published GGUF files (unsloth/Ministral-3-8B-Instruct-2512-GGUF). “Estimated” sizes are derived from the parameter count and are typically within a few percent. The RAM columns add the context cache and runtime overhead to the download size.

Other sizes of Ministral 3