What can you run with 24GB of RAM?
With 24GB RAM you can run 22 of the 65 open-source models we track, up to 30B parameters, using each model's Q4 file where one is published and otherwise the smallest file that is. The most downloaded that fits is Qwen3.8-27B, needing 19 GB.
Typical machines: MacBook Air M5 (24GB) · MacBook Pro M5 Pro (base) · Mac mini M5 Pro (base). We hold back 20% of RAM (2 to 4GB) for the operating system, leaving 21 GB for a model.
24GB RAM decides whether a model loads. How fast it answers depends on your machine's memory bandwidth, which differs between machines with the same amount of memory. Why bandwidth sets the speed →
Models that run on 24GB RAM in 2026
| Model↕ | Size↕ | Memory↑ | Downloads (30 days)↕ |
|---|---|---|---|
| MiniCPM-V-4.7-1BOpenBMB | 1.6B | 1.4 GBRuns well | 241,677 |
| K2-Horizon-0.9BMBZUAI Institute of Foundation Models | 1.1B | 1.4 GBRuns well | 11,220 |
| LFM3-1.7BLiquid AI | 1.7B | 1.8 GBRuns well | 42,384 |
| LFM3-VL-2BLiquid AI | 1.9B | 1.8 GBRuns well | 10,141 |
| d1-2BLiquid AI | 1.9B | 1.8 GBRuns well | 5,047 |
| MiniCPM5-2BOpenBMB | 2.5B | 2.3 GBRuns well | 1,067,287 |
| North-Micro-Vision-InstructCohere | 2.5B | 2.3 GBRuns well | 21,515 |
| d1-3BLiquid AI | 3.1B | 2.5 GBRuns well | 33,299 |
| granite-4.2-3bIBM | 3.7B | 3.1 GBRuns well | 33,072 |
| Mage-VLMicrosoft | 4.7B | 3.9 GBRuns well | 7,048 |
| FrogNano-4B-2609Microsoft | 4.7B | 3.9 GBRuns well | 2,761 |
| K2-Horizon-3.7BMBZUAI Institute of Foundation Models | 5.1B | 4.3 GBRuns well | 18,900 |
| Ling-3.0-tinyinclusionAI · MoE | 7.9B1.6B active | 6.2 GBRuns well | 14,336 |
| granite-4.2-8bIBM | 8.8B | 6.6 GBRuns well | 70,418 |
| K2-Horizon-7BMBZUAI Institute of Foundation Models | 9B | 6.8 GBRuns well | 84,908 |
| Ornith-1.5-9BDeepReinforce | 9.7B | 6.9 GBRuns well | 475,026 |
| MiMo-V2.6-Distill-Qwen-9BXiaomi | 9.4B | 7.0 GBRuns well | 18,263 |
| granite-switch-4.1-8bIBM | 8.8B | 7.8 GBRuns well | 4,521 |
| Qwen3.8-27BAlibaba / Qwen | 28B | 19 GBTight | 7,915,637 |
| Hy-Memory-30B-A3BTencent · MoE | 30B3B active | 20 GBTight | 6,130 |
| granite-4.2-30bIBM | 29B | 21 GBTight | 32,468 |
| Muse-Glimmer-30BMeta AI | 30B | 21 GBTight | 194,076 |
Sorted by memory, smallest first. Click any column to change it.
Step up to 32GB RAM and 9 more models come within reach
Including NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 (32B), MiniCPM-V-4.7-35B-A3B (35B) and Ornith-1.5-35B-A3B (36B).
See everything 32GB RAM runs →All figures at Q4_K_M quantization and 4K context. “Memory” is the model's download size from Hugging Face, plus its context cache calculated from the model's configuration, plus a runtime allowance of 10% of the model (at least 0.5GB, at most 3GB). How this is calculated
Image generators that also fit
These make pictures rather than text. Their memory use scales with the resolution you generate at, not conversation length, so treat these figures as a floor rather than a ceiling.
What you'd need more memory for
The next models up, and what they ask for.