How much RAM does Hy3 need?

Hy3 needs about 187 GB of memory at Q4_K_M quantization with 4K context. The download itself is 182 GB; the extra covers the context cache and runtime overhead.

Can I run Hy3 on a laptop?

Not on typical consumer hardware. Hy3 needs 187 GB, which is beyond a normal laptop or desktop.

Hy3: hardware requirements

Hy3 needs about 187 GB of memory at Q4 quantization — a 182 GB download plus room for context and overhead. That is beyond consumer hardware; use it through an API instead.

Parameters

299B

Tier

Server only

Licence

See model card

Released

2026-04-22

This is a mixture-of-experts model. Only a fraction of its 299B parameters are used for each token, so it runs faster than its size suggests — but all of it still has to fit in memory. The speed is that of a small model; the memory requirement is that of a large one. More on this →

Will it run on your machine?

8GB RAMNot enough memory 16GB RAMNot enough memory 24GB RAMNot enough memory 32GB RAMNot enough memory 64GB RAMNot enough memory 128GB RAMNot enough memory 8GB VRAMNot enough memory 12GB VRAMNot enough memory 16GB VRAMNot enough memory 24GB VRAMNot enough memory 32GB VRAMNot enough memory

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

Quant	Download	RAM @ 4K	RAM @ 32K	Source
Q4_K_Mrecommended	182 GB	187 GB	196 GB	measured
Q5_K_M	212 GB	216 GB	226 GB	estimated
Q6_K	245 GB	250 GB	259 GB	estimated
Q8_0	317 GB	322 GB	331 GB	estimated
BF16	598 GB	602 GB	612 GB	estimated

“Measured” sizes are read from published GGUF files (AngelSlim/Hy3-GGUF). “Estimated” sizes are derived from the parameter count and are typically within a few percent. The RAM columns add the context cache and runtime overhead to the download size.

Model card on HuggingFace →API specs & pricing →Verified 2026-09-13Tracked for 12 months after release