What can you run with 128GB of RAM?

With 128GB RAM you can run 37 of the 66 open-source models we track, up to 127B parameters, using each model's Q4 file where one is published and otherwise the smallest file that is. The most downloaded that fits is Qwen3.8-27B, needing 19 GB.

Typical machines: MacBook Pro M5 Max (128GB) · Mac Studio M5 Max (128GB) · Workstation desktops. We hold back 20% of RAM (2 to 4GB) for the operating system, leaving 133 GB for a model.

128GB RAM decides whether a model loads. How fast it answers depends on your machine's memory bandwidth, which differs between machines with the same amount of memory. Why bandwidth sets the speed →

Models that run on 128GB RAM in 2026

Model↕Size↕Memory↑Downloads (30 days)↕
MiniCPM-V-4.7-1BOpenBMB1.6B1.4 GBRuns well184,495
K2-Horizon-0.9BMBZUAI Institute of Foundation Models1.1B1.4 GBRuns well13,425
LFM3-1.7BLiquid AI1.7B1.8 GBRuns well15,885
LFM3-VL-2BLiquid AI1.9B1.8 GBRuns well4,193
MiniCPM5-2BOpenBMB2.5B2.3 GBRuns well1,180,516
d1-3BLiquid AI3.1B2.5 GBRuns well31,374
granite-4.2-3bIBM3.7B3.1 GBRuns well37,116
Mage-VLMicrosoft4.7B3.9 GBRuns well7,645
FrogNano-4B-2609Microsoft4.7B3.9 GBRuns well2,663
K2-Horizon-3.7BMBZUAI Institute of Foundation Models5.1B4.3 GBRuns well24,267
North-Micro-Vision-InstructCohere2.5B6.0 GBRuns well33,984
Ling-3.0-tinyinclusionAI · MoE7.9B1.6B active6.2 GBRuns well13,391
granite-4.2-8bIBM8.8B6.6 GBRuns well70,118
K2-Horizon-7BMBZUAI Institute of Foundation Models9B6.8 GBRuns well87,218
Ornith-1.5-9BDeepReinforce9.7B6.9 GBRuns well462,696
MiMo-V2.6-Distill-Qwen-9BXiaomi9.4B7.0 GBRuns well19,920
granite-switch-4.1-8bIBM8.8B7.8 GBRuns well3,734
Qwen3.8-27BAlibaba / Qwen28B19 GBRuns well7,509,924
Hy-Memory-30B-A3BTencent · MoE30B3B active20 GBRuns well5,468
granite-4.2-30bIBM29B21 GBRuns well36,633
Muse-Glimmer-30BMeta AI30B21 GBRuns well202,402
Xing4.0-29B-A4BChina Telecom AI (TeleAI) · MoE31B4B active23 GBRuns well7,749
MiniCPM-V-4.7-35B-A3BOpenBMB · MoE35B3B active24 GBRuns well334,870
Nex-N2.5-miniNex-AGI · MoE35B7B active24 GBRuns well3,200
Ornith-1.5-35B-A3BDeepReinforce · MoE36B3B active24 GBRuns well268,879
granite-switch-4.1-30bIBM30B24 GBRuns well2,759
K2-Horizon-32BMBZUAI Institute of Foundation Models35B25 GBRuns well6,150
K2-Horizon-MoVA-36B-A4BMBZUAI Institute of Foundation Models · MoE37B4B active25 GBRuns well12,840
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16NVIDIA · MoE32B3B active28 GBRuns well1,117,157
NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GBNVIDIA · MoE74B9B active29 GBRuns well12,123
Bonsai-27B-unpackedPrismML27B59 GBRuns well13,075
Ternary-Bonsai-27B-unpackedPrismML27B59 GBRuns well651
Ornith-1.5-122BDeepReinforce · MoE125B25B active79 GBRuns well105,803
Ling-3.0-flash-FininclusionAI · MoE127B25B active84 GBRuns well1,976
Ling-3.0-flash-VLinclusionAI · MoE125B25B active85 GBRuns well11,564
Laguna-S-2.1Poolside · MoE118B24B active100 GBRuns well619,054
Ling-3.0-flash-SanteinclusionAI · MoE127B25B active117 GBTight1,075

Sorted by memory, smallest first. Click any column to change it.

All figures at Q4_K_M quantization and 4K context. “Memory” is the model's download size from Hugging Face, plus its context cache calculated from the model's configuration, plus a runtime allowance of 10% of the model (at least 0.5GB, at most 3GB). How this is calculated

Image generators that also fit

These make pictures rather than text. Their memory use scales with the resolution you generate at, not conversation length, so treat these figures as a floor rather than a ceiling.

What you'd need more memory for

The next models up, and what they ask for.

Other hardware

Verified against HuggingFace on 2026-10-30New to this? Start here →Runs on a laptop and up · last 120 days only