What can you run with 32GB of RAM?

With 32GB RAM you can run 30 of the 66 open-source models we track, up to 74B parameters, using each model's Q4 file where one is published and otherwise the smallest file that is. The most downloaded that fits is Qwen3.8-27B, needing 19 GB.

Typical machines: MacBook Air M5 (32GB) · MacBook Pro 14-inch M5 (32GB) · Gaming desktops. We hold back 20% of RAM (2 to 4GB) for the operating system, leaving 30 GB for a model.

32GB RAM decides whether a model loads. How fast it answers depends on your machine's memory bandwidth, which differs between machines with the same amount of memory. Why bandwidth sets the speed →

Models that run on 32GB RAM in 2026

Model↕Size↕Memory↑Downloads (30 days)↕
MiniCPM-V-4.7-1BOpenBMB1.6B1.4 GBRuns well184,495
K2-Horizon-0.9BMBZUAI Institute of Foundation Models1.1B1.4 GBRuns well13,425
LFM3-1.7BLiquid AI1.7B1.8 GBRuns well15,885
LFM3-VL-2BLiquid AI1.9B1.8 GBRuns well4,193
MiniCPM5-2BOpenBMB2.5B2.3 GBRuns well1,180,516
d1-3BLiquid AI3.1B2.5 GBRuns well31,374
granite-4.2-3bIBM3.7B3.1 GBRuns well37,116
Mage-VLMicrosoft4.7B3.9 GBRuns well7,645
FrogNano-4B-2609Microsoft4.7B3.9 GBRuns well2,663
K2-Horizon-3.7BMBZUAI Institute of Foundation Models5.1B4.3 GBRuns well24,267
North-Micro-Vision-InstructCohere2.5B6.0 GBRuns well33,984
Ling-3.0-tinyinclusionAI · MoE7.9B1.6B active6.2 GBRuns well13,391
granite-4.2-8bIBM8.8B6.6 GBRuns well70,118
K2-Horizon-7BMBZUAI Institute of Foundation Models9B6.8 GBRuns well87,218
Ornith-1.5-9BDeepReinforce9.7B6.9 GBRuns well462,696
MiMo-V2.6-Distill-Qwen-9BXiaomi9.4B7.0 GBRuns well19,920
granite-switch-4.1-8bIBM8.8B7.8 GBRuns well3,734
Qwen3.8-27BAlibaba / Qwen28B19 GBRuns well7,509,924
Hy-Memory-30B-A3BTencent · MoE30B3B active20 GBRuns well5,468
granite-4.2-30bIBM29B21 GBRuns well36,633
Muse-Glimmer-30BMeta AI30B21 GBRuns well202,402
Xing4.0-29B-A4BChina Telecom AI (TeleAI) · MoE31B4B active23 GBRuns well7,749
MiniCPM-V-4.7-35B-A3BOpenBMB · MoE35B3B active24 GBRuns well334,870
Nex-N2.5-miniNex-AGI · MoE35B7B active24 GBRuns well3,200
Ornith-1.5-35B-A3BDeepReinforce · MoE36B3B active24 GBRuns well268,879
granite-switch-4.1-30bIBM30B24 GBRuns well2,759
K2-Horizon-32BMBZUAI Institute of Foundation Models35B25 GBRuns well6,150
K2-Horizon-MoVA-36B-A4BMBZUAI Institute of Foundation Models · MoE37B4B active25 GBRuns well12,840
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16NVIDIA · MoE32B3B active28 GBTight1,117,157
NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GBNVIDIA · MoE74B9B active29 GBTight12,123

Sorted by memory, smallest first. Click any column to change it.

Upgrade

Including Bonsai-27B-unpacked (27B) and Ternary-Bonsai-27B-unpacked (27B).

See everything 64GB RAM runs →

All figures at Q4_K_M quantization and 4K context. “Memory” is the model's download size from Hugging Face, plus its context cache calculated from the model's configuration, plus a runtime allowance of 10% of the model (at least 0.5GB, at most 3GB). How this is calculated

Image generators that also fit

These make pictures rather than text. Their memory use scales with the resolution you generate at, not conversation length, so treat these figures as a floor rather than a ceiling.

What you'd need more memory for

The next models up, and what they ask for.

Other hardware

Verified against HuggingFace on 2026-10-30New to this? Start here →Runs on a laptop and up · last 120 days only