MiniCPM5-2B: hardware requirements

MiniCPM5-2B needs about 2.3 GB of memory at Q4_K_M quantization: a 1.6 GB download plus room for context and a runtime allowance. That fits a machine with 8GB RAM.

Parameters
2.5B
Tier
Runs on a laptop
Licence
See model card
Released
2026-05-21

Will it run on your machine?

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Q4_K_Mrecommended1.6 GB2.3 GB3.5 GBopenbmb/MiniCPM5-2B-GGUF
Q8_02.7 GB3.4 GB4.6 GBopenbmb/MiniCPM5-2B-GGUF

Download sizes are measured from the published files named in the Source column. The RAM columns add the context cache, calculated from the model's configuration, and a runtime allowance of 10% of the download (at least 0.5GB, at most 3GB).

Model card on HuggingFace →API specs & pricing →Verified 2026-10-30Listed for 120 days after release