K2-Horizon-32B: hardware requirements
K2-Horizon-32B needs about 25 GB of memory at Q4_K_M quantization: a 22 GB download plus room for context and a runtime allowance. That fits a machine with 32GB RAM.
Parameters
35B
Tier
Needs a good desktop
Licence
See model card
Released
2026-09-01
Will it run on your machine?
8GB RAMNot enough memory16GB RAMNot enough memory24GB RAMNot enough memory32GB RAMRuns well64GB RAMRuns well128GB RAMRuns well8GB VRAMNot enough memory12GB VRAMNot enough memory16GB VRAMNot enough memory24GB VRAMNot enough memory32GB VRAMRuns well
Download sizes by quantization
Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?
| Quant | Download | RAM @ 4K | RAM @ 32K | Source |
|---|---|---|---|---|
| Q4_K_Mrecommended | 22 GB | 25 GB | 33 GB | bartowski/K2-Horizon-32B-GGUF |
| Q5_K_M | 26 GB | 30 GB | 37 GB | bartowski/K2-Horizon-32B-GGUF |
| Q6_K | 30 GB | 35 GB | 42 GB | bartowski/K2-Horizon-32B-GGUF |
| Q8_0 | 37 GB | 41 GB | 49 GB | bartowski/K2-Horizon-32B-GGUF |
| BF16 | 70 GB | 74 GB | 81 GB | bartowski/K2-Horizon-32B-GGUF |
Download sizes are measured from the published files named in the Source column. The RAM columns add the context cache, calculated from the model's configuration, and a runtime allowance of 10% of the download (at least 0.5GB, at most 3GB).
Other sizes of K2-Horizon
K2-Horizon-0.9B1.1B · 1.4 GBK2-Horizon-3.7B5.1B · 4.3 GBK2-Horizon-7B9B · 6.8 GBK2-Horizon-375B-A23B379B · 242 GB
Model card on HuggingFace →API specs & pricing →Verified 2026-11-10Listed for 120 days after release