GLM-5.2: hardware requirements

GLM-5.2 needs about 485 GB of memory at Q4 quantization — a 466 GB download plus room for context and overhead. That is beyond consumer hardware; use it through an API instead.

Parameters
753B
Tier
Server only
Licence
mit
Released
2026-06-16

Will it run on your machine?

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Q4_K_Mrecommended466 GB485 GB595 GBmeasured
Q5_K_M561 GB580 GB690 GBmeasured
Q6_K626 GB645 GB755 GBmeasured
Q8_0801 GB820 GB930 GBmeasured
BF161508 GB1527 GB1637 GBmeasured

“Measured” sizes are read from published GGUF files (unsloth/GLM-5.2-GGUF). “Estimated” sizes are derived from the parameter count and are typically within a few percent. The RAM columns add the context cache and runtime overhead to the download size.