What can you run with 64GB of RAM?

With 64GB RAM you can run 94 of the 129 open-source models we track — up to about 91B parameters at Q4 quantization. The most popular that fits is Qwen3.5-9B, needing 6.8 GB and generating around ~10 tok/s on typical hardware of this size.

Typical machines: MacBook Pro M4 Max · Mac Studio · High-end desktop. After the operating system takes its share, about 64 GB is free for a model.

Having the memory is not the same as having the speed

64GB RAM decides whether a model loads. How fast it answers is decided by memory bandwidth — how quickly your machine can read the model, which it must do once for every word it writes. Machines with 64GB RAM span 90–614 GB/s, so the fastest is about 6.8× quicker than the slowest with identical capacity. The table quotes a DDR5-5600; pick yours below to see the difference. Why bandwidth and not the processor →

90 GB/sDesktop or laptop — DDR5-5600· 5,600 MT/s × 128-bit dual channel ÷ 8 = 89.6 GB/s
128 GB/sEnthusiast desktop — DDR5-8000· 8,000 MT/s × 128-bit dual channel ÷ 8 = 128 GB/s
150 GB/sMac — M3 Pro· Apple published specification for the M3 Pro: 150 GB/s (lower than the M2 Pro)
200 GB/sMac — M1 Pro· Apple published specification for the M1 Pro: 200 GB/s
200 GB/sMac — M2 Pro· Apple published specification for the M2 Pro: 200 GB/s
273 GB/sMac — M4 Pro· Apple published specification for the M4 Pro: 273 GB/s
307 GB/sMac — M5 Pro· Apple published specification for the M5 Pro: up to 307 GB/s
400 GB/sMac — M1 Max· Apple published specification for the M1 Max: 400 GB/s
400 GB/sMac — M2 Max· Apple published specification for the M2 Max: 400 GB/s
400 GB/sMac — M3 Max· Apple published specification for the M3 Max: 400 GB/s (16-core GPU; the 14-core is 300 GB/s)
546 GB/sMac — M4 Max· Apple published specification for the M4 Max: 546 GB/s
614 GB/sMac — M5 Max· Apple published specification for the M5 Max: 614 GB/s (40-core GPU; the 32-core is 460 GB/s)

Models that run on 64GB RAM in 2026

ModelSizeMemoryEst. speedDownloadsFeels like
granite-embedding-97m-multilingual-r2Ibm97M603 MBRuns well~994 tok/s97,079Fast
LFM2.5-Encoder-230MLiquid Ai230M793 MBRuns well~422 tok/s13,432Fast
LFM2.5-230MLiquid Ai230M808 MBRuns well~381 tok/s55,999Fast
granite-embedding-311m-multilingual-r2Ibm312M821 MBRuns well~231 tok/s64,530Fast
granite-speech-5.0-470m-turboctcIbm473M857 MBRuns well~205 tok/s11,294Fast
harrier-oss-v1-270mMicrosoft268M865 MBRuns well~231 tok/s727,222Fast
LFM2.5-Encoder-350M-Policy-LinterLiquid Ai355M885 MBRuns well~273 tok/s9,957Fast
LFM2.5-VL-450MLiquid Ai449M900 MBRuns well~255 tok/s67,396Fast
nemotron-3.5-asr-streaming-0.6bNVIDIA638M1.1 GBRuns well~118 tok/s917,259Fast
Qwen3.5-0.8BAlibaba / Qwen873M1.3 GBRuns well~110 tok/s2,881,964Fast
privacy-filterOpenAI · MoE1.4B1.4 GBRuns well~346 tok/s280M active456,933Fast
LFM2.5-1.2B-InstructLiquid Ai1.2B1.4 GBRuns well~80 tok/s366,847Fast
LFM2.5-VL-1.6BLiquid Ai1.6B1.4 GBRuns well~80 tok/s248,110Fast
Nemotron-3-Embed-1B-BF16NVIDIA1.1B1.5 GBRuns well~85 tok/s386,914Fast
Hy-MT2-1.8BTencent2B1.9 GBRuns well~52 tok/s24,475Fast
MiniMax-Music3MiniMax2.4B2.1 GBRuns well~42 tok/s23,217Fast
Qwen3.5-2BAlibaba / Qwen2.3B2.1 GBRuns well~42 tok/s3,097,484Fast
cohere-transcribe-arabic-07-2026Cohere2.1B2.3 GBRuns well~38 tok/s51,893Fast
cohere-transcribe-03-2026Cohere2.1B2.3 GBRuns well~38 tok/s607,964Fast
granite-speech-4.1-2bIbm2.3B2.4 GBRuns well~37 tok/s237,181Fast
LFM2.5-2.6BLiquid Ai2.7B2.5 GBRuns well~35 tok/s133,677Fast
LFM2.5-VL-3BLiquid Ai3.1B2.5 GBRuns well~35 tok/s24,282Fast
granite-4.0-1b-speechIbm2.3B2.5 GBRuns well~36 tok/s74,644Fast
LFM2.5-Audio-1.5BLiquid Ai1.5B2.6 GBRuns well~32 tok/s1,702Fast
Unlimited-OCRBaidu AI3.3B2.7 GBRuns well~30 tok/s3,008,635Fast
Nemotron-Labs-Diffusion-3BNVIDIA3B2.8 GBRuns well~32 tok/s35,414Fast
LocateAnything-3BNVIDIA3.8B2.8 GBRuns well~28 tok/s95,054Fast
granite-4.1-3bIbm3.4B2.9 GBRuns well~28 tok/s122,076Fast
granite-4.2-3bIbm3.7B3.1 GBRuns well~26 tok/s14,073Fast
granite-4.0-3b-visionIbm4B3.1 GBRuns well~26 tok/s1,069Fast
Shieldstral-1.0-3BMistral AI3.8B3.1 GBRuns well~27 tok/s20,895Fast
Ministral-3-3B-Instruct-2512Mistral AI3.8B3.1 GBRuns well~27 tok/s544,419Fast
Nemotron-Labs-Diffusion-3B-BaseNVIDIA3.8B3.3 GBRuns well~25 tok/s19,213Fast
Cosmos3-EdgeNVIDIA3.9B3.3 GBRuns well~25 tok/s1,325,763Fast
Nemotron-3.5-Content-SafetyNVIDIA4.3B3.6 GBRuns well~23 tok/s134,547Comfortable
gemma-4-E2B-itGoogle DeepMind5.1B3.8 GBRuns well~19 tok/s3,235,641Comfortable
Qwen3.5-4BAlibaba / Qwen4.7B3.8 GBRuns well~21 tok/s7,681,585Comfortable
Fara1.5-4BMicrosoft4.5B4.0 GBRuns well~20 tok/s2,786Comfortable
MolmoWeb-4BAi24.9B4.1 GBRuns well~20 tok/s2,152Comfortable
NVIDIA-Nemotron-3-Nano-4B-BF16NVIDIA4B4.1 GBRuns well~21 tok/s712,701Comfortable
Fara-7BMicrosoft8.3B5.5 GBRuns well~12 tok/s1,593Comfortable
Hy-MT2-7BTencent8B5.7 GBRuns well~13 tok/s12,004Comfortable
LFM2.5-8B-A1BLiquid Ai · MoE8.5B5.9 GBRuns well~96 tok/s1B active96,675Fast
Nemotron-3-Embed-8B-BF16NVIDIA8B5.9 GBRuns well~12 tok/s81,804Comfortable
Nemotron-Labs-Diffusion-8BNVIDIA8B5.9 GBRuns well~12 tok/s163,233Comfortable
Cosmos3-NanoNVIDIA16B6.2 GBRuns well~12 tok/s244,209Comfortable
gemma-4-E4B-itGoogle DeepMind8B6.2 GBRuns well~11 tok/s4,740,694Comfortable
Nemotron-Labs-Diffusion-8B-BaseNVIDIA8.5B6.2 GBRuns well~11 tok/s280,417Comfortable
Ministral-3-8B-Instruct-2512Mistral AI8.9B6.3 GBRuns well~11 tok/s119,379Comfortable
granite-4.1-8bIbm8.8B6.3 GBRuns well~11 tok/s1,441,995Comfortable
MolmoWeb-8BAi28.7B6.4 GBRuns well~11 tok/s1,679Comfortable
granite-4.2-8bIbm8.8B6.6 GBRuns well~11 tok/s12,050Comfortable
Ornith-1.0-9BDeepreinforce9B6.7 GBRuns well~10 tok/s2,250,422Comfortable
Qwen3.5-9BAlibaba / Qwen9.7B6.8 GBRuns well~10 tok/s13,660,443Comfortable
GLM-4.6V-FlashZhipu AI10B7.0 GBRuns well~9.5 tok/s282,562Comfortable
Fara1.5-9BMicrosoft9.4B7.0 GBRuns well~9.9 tok/s4,461Comfortable
Olmo-3-7B-InstructAi27.3B7.2 GBRuns well~13 tok/s406,776Comfortable
gemma-4-12B-itGoogle DeepMind12B9.6 GBRuns well~8.1 tok/s3,165,860Comfortable
Ministral-3-14B-Instruct-2512Mistral AI14B9.7 GBRuns well~7.1 tok/s198,169Slow
Nemotron-Labs-Diffusion-14BNVIDIA14B10.0 GBRuns well~6.9 tok/s12,153Slow
NVIDIA-NemotronLabs-VoiceChat-11BNVIDIA11B15 GBRuns well~4.9 tok/s3,459Slow
Voxtral-Small-24B-2507Mistral AI24B16 GBRuns well~4.1 tok/s200,361Slow
Qwen3.8-27BAlibaba / Qwen28B19 GBRuns well~3.6 tok/s5,254,882Slow
Qwen3.5-27BAlibaba / Qwen28B19 GBRuns well~3.5 tok/s2,817,727Slow
diffusiongemma-26B-A4B-itGoogle DeepMind · MoE26B19 GBRuns well~22 tok/s4B active1,170,594Comfortable
gemma-4-26B-A4B-itGoogle DeepMind · MoE26B20 GBRuns well~22 tok/s4B active7,837,690Comfortable
granite-4.1-30bIbm29B20 GBRuns well~3.3 tok/s177,103Slow
Fara1.5-27BMicrosoft27B20 GBRuns well~3.3 tok/s2,458Slow
Hy-MT2-30B-A3BTencent · MoE30B20 GBRuns well~32 tok/s3B active22,910Fast
granite-4.2-30bIbm29B21 GBRuns well~3.3 tok/s5,244Slow
North-Mini-Code-1.0Cohere · MoE30B22 GBRuns well~15 tok/s6.1B active11,421Comfortable
Gemma-4-26B-A4B-NVFP4NVIDIA · MoE14B22 GBRuns well~11 tok/s4B active1,560,310Comfortable
diffusiongemma-26B-A4B-it-NVFP4NVIDIA · MoE14B22 GBRuns well~11 tok/s4B active108,924Comfortable
GLM-4.7-FlashZhipu AI31B22 GBRuns well~3.1 tok/s2,071,716Slow
Olmo-3.1-32B-InstructAi232B23 GBRuns well~3.0 tok/s51,153Slow
Ornith-1.0-35BDeepreinforce · MoE35B24 GBRuns well~14 tok/s7B active2,736,644Comfortable
Gemma-4-31B-IT-NVFP4NVIDIA21B24 GBRuns well~3.3 tok/s2,388,034Slow
Qwen3.6-35B-A3BAlibaba / Qwen · MoE36B25 GBRuns well~32 tok/s3B active5,623,400Fast
Qwen-AgentWorld-35B-A3BAlibaba / Qwen · MoE35B25 GBRuns well~31 tok/s3B active60,898Fast
gemma-4-31B-itGoogle DeepMind31B25 GBRuns well~3.1 tok/s7,973,406Slow
Qwen3.5-35B-A3BAlibaba / Qwen · MoE36B25 GBRuns well~31 tok/s3B active2,437,252Fast
Alpamayo2-SuperNVIDIA36B26 GBRuns well~2.7 tok/s17,622Very slow
Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4NVIDIA · MoE18B27 GBRuns well~16 tok/s3B active1,570,072Comfortable
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4NVIDIA · MoE18B28 GBRuns well~14 tok/s3B active1,064,894Comfortable
North-Mini-Code-1.0-fp8Cohere · MoE31B36 GBRuns well~9.1 tok/s6.1B active35,994Comfortable
Qwen3.6-27BAlibaba / Qwen28B41 GBRuns well~1.6 tok/s6,615,659Very slow
Cosmos3-Super-Text2Image-4StepNVIDIA64B43 GBRuns well~1.5 tok/s97,839Very slow
Cosmos3-Super-Image2VideoNVIDIA65B43 GBRuns well~1.5 tok/s75,852Very slow
Cosmos3-SuperNVIDIA65B43 GBRuns well~1.5 tok/s117,430Very slow
Nemotron-Labs-TwoTower-30B-A3B-Base-BF16NVIDIA · MoE63B46 GBRuns well~31 tok/s3B active793Fast
Qwen3-Next-80B-A3B-InstructAlibaba / Qwen · MoE81B52 GBRuns well~24 tok/s3B active287,898Comfortable
gpt-oss-puzzle-88BNVIDIA91B54 GBRuns well~1.2 tok/s140,544Very slow
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4NVIDIA · MoE45B63 GBTight~5.4 tok/s9B active345,084Slow
MiniMax-H3MiniMax33B64 GBTight~1.1 tok/s5,092,067Very slow

Sorted by memory, smallest first — click any column to change it.

Upgrade

Including Qwen3.5-122B-A10B (122B), NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 (67B) and Step-3.5-Flash (199B) — around ~59 tok/s on a typical machine that size.

See everything 128GB RAM runs →

All figures at Q4_K_M quantization, 4K context. “Memory” includes the model, its context cache and runtime overhead. Speed is calculated, not benchmarked: 90 GB/s × 0.65 ÷ bytes read per token, assuming a DDR5-5600. Scale it by your own machine's bandwidth from the list above. Mixture-of-experts models read only their active parameters per token, which is why some large ones outrun smaller dense models.

Image generators that also fit

These make pictures rather than text. Their memory use scales with the resolution you generate at, not conversation length, so treat these figures as a floor rather than a ceiling.

What you'd need more memory for

The next models up, and what they ask for.

Other hardware

Verified against HuggingFace on 2026-09-04New to this? Start here →Runs on a laptop and up · last 12 months only