Hy4-preview: hardware requirements
Hy4-preview needs about 471 GB of memory at Q4_K_M quantization: a 467 GB download plus room for context and a runtime allowance. That is beyond consumer hardware; use it through an API instead.
Will it run on your machine?
Use it without your own hardware
OpenRouter lists Hy4 preview at $0.834 per million input tokens and $2.501 per million output tokens.
Price as listed on OpenRouter today. Speed is for hosted servers, not a home computer.
Download sizes by quantization
Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?
| Quant | Download | RAM @ 4K | RAM @ 32K | Source |
|---|---|---|---|---|
| Q4_K_Mrecommended | 467 GB | 471 GB | 476 GB | AngelSlim/Hy4-preview-GGUF |
Download sizes are measured from the published files named in the Source column. The RAM columns add the context cache, calculated from the model's configuration, and a runtime allowance of 10% of the download (at least 0.5GB, at most 3GB).