ERNIE-4.5-0.3B-PT: hardware requirements
ERNIE-4.5-0.3B-PT needs about 853 MB of memory at Q4 quantization — a 241 MB download plus room for context and overhead. That fits a machine with 8GB RAM.
Parameters
361M
Tier
Runs on a laptop
Licence
See model card
Released
2025-08-12
Will it run on your machine?
8GB RAMRuns well16GB RAMRuns well32GB RAMRuns well64GB RAMRuns well128GB RAMRuns well8GB VRAMRuns well12GB VRAMRuns well16GB VRAMRuns well24GB VRAMRuns well32GB VRAMRuns well
Download sizes by quantization
Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?
| Quant | Download | RAM @ 4K | RAM @ 32K | Source |
|---|---|---|---|---|
| Q4_K_Mrecommended | 241 MB | 853 MB | 1.4 GB | measured |
| Q5_K_M | 269 MB | 881 MB | 1.4 GB | measured |
| Q6_K | 298 MB | 911 MB | 1.4 GB | measured |
| Q8_0 | 386 MB | 998 MB | 1.5 GB | measured |
| BF16 | 724 MB | 1.3 GB | 1.9 GB | measured |
“Measured” sizes are read from published GGUF files (bartowski/baidu_ERNIE-4.5-0.3B-PT-GGUF). “Estimated” sizes are derived from the parameter count and are typically within a few percent. The RAM columns add the context cache and runtime overhead to the download size.