Aion-1.0-Instruct-2.3B: hardware requirements

Aion-1.0-Instruct-2.3B needs about 2.6 GB of memory at Q4_K_M quantization: a 1.6 GB download plus room for context and a runtime allowance. That fits a machine with 8GB RAM.

Parameters
2.3B
Tier
Runs on a laptop
Licence
See model card
Released
2026-11-18

Will it run on your machine?

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Q4_K_Mrecommended1.6 GB2.6 GB5.9 GBAtomicChat/Aion-1.0-Instruct-2.3B-GGUF
Q5_K_M1.8 GB2.8 GB6.1 GBAtomicChat/Aion-1.0-Instruct-2.3B-GGUF
Q8_02.4 GB3.4 GB6.7 GBAtomicChat/Aion-1.0-Instruct-2.3B-GGUF
BF164.6 GB5.6 GB8.9 GBAtomicChat/Aion-1.0-Instruct-2.3B-GGUF

Download sizes are measured from the published files named in the Source column. The RAM columns add the context cache, calculated from the model's configuration, and a runtime allowance of 10% of the download (at least 0.5GB, at most 3GB).

Model card on HuggingFace →API specs & pricing →Verified 2026-11-20Listed for 120 days after release