Inkling-2-Mini: hardware requirements

Inkling-2-Mini needs about 19 GB of memory at Q4_K_M quantization: a 17 GB download plus room for context and a runtime allowance. That fits a machine with 32GB RAM.

Parameters
26B
Tier
Needs a good desktop
Licence
See model card
Released
2026-07-16

Will it run on your machine?

Use it without your own hardware

OpenRouter lists Inkling 2 Mini at $0.10 per million input tokens and $0.40 per million output tokens. Artificial Analysis measured hosted providers generating 280 tokens per second (Nov 21, 2026).

Price as listed on OpenRouter today. Speed is for hosted servers, not a home computer.

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Q4_K_Mrecommended17 GB19 GB21 GBunsloth/Inkling-2-Mini-GGUF

Download sizes are measured from the published files named in the Source column. The RAM columns add the context cache, calculated from the model's configuration, and a runtime allowance of 10% of the download (at least 0.5GB, at most 3GB).

Other sizes of Inkling

Model card on HuggingFace →API specs & pricing →Verified 2026-11-21Listed for 120 days after release