Inkling-2-Mini: hardware requirements
Inkling-2-Mini needs about 19 GB of memory at Q4_K_M quantization: a 17 GB download plus room for context and a runtime allowance. That fits a machine with 32GB RAM.
Will it run on your machine?
Use it without your own hardware
OpenRouter lists Inkling 2 Mini at $0.10 per million input tokens and $0.40 per million output tokens. Artificial Analysis measured hosted providers generating 280 tokens per second (Nov 21, 2026).
Price as listed on OpenRouter today. Speed is for hosted servers, not a home computer.
Download sizes by quantization
Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?
| Quant | Download | RAM @ 4K | RAM @ 32K | Source |
|---|---|---|---|---|
| Q4_K_Mrecommended | 17 GB | 19 GB | 21 GB | unsloth/Inkling-2-Mini-GGUF |
Download sizes are measured from the published files named in the Source column. The RAM columns add the context cache, calculated from the model's configuration, and a runtime allowance of 10% of the download (at least 0.5GB, at most 3GB).