TPSTokens Per Second

Ornith-1.5-9B: hardware requirements

Ornith-1.5-9B needs about 6.9 GB of memory at Q4_K_M quantization: a 5.8 GB download plus room for context and a runtime allowance. That fits a machine with 16GB RAM.

Parameters
9.7B
Tier
Runs on a laptop
Licence
See model card
Released
2026-08-18

Will it run on your machine?

8GB RAMNot enough memory16GB RAMRuns well24GB RAMRuns well32GB RAMRuns well64GB RAMRuns well128GB RAMRuns well8GB VRAMTight fit12GB VRAMRuns well16GB VRAMRuns well24GB VRAMRuns well32GB VRAMRuns well

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Q4_K_Mrecommended5.8 GB6.9 GB11 GBornith-ai/Ornith-1.5-9B-GGUF
Q5_K_M6.6 GB7.8 GB12 GBornith-ai/Ornith-1.5-9B-GGUF
Q6_K7.6 GB8.9 GB13 GBornith-ai/Ornith-1.5-9B-GGUF
Q8_09.8 GB11 GB15 GBornith-ai/Ornith-1.5-9B-GGUF
BF1619 GB22 GB26 GBornith-ai/Ornith-1.5-9B-GGUF

Download sizes are measured from the published files named in the Source column. The RAM columns add the context cache, calculated from the model's configuration, and a runtime allowance of 10% of the download (at least 0.5GB, at most 3GB).

Other sizes of Ornith-1.5

Ornith-1.5-35B-A3B36B · 24 GBOrnith-1.5-122B125B · 79 GBOrnith-1.5-397B403B · 248 GB
Model card on HuggingFace →API specs & pricing →Verified 2026-10-30Listed for 120 days after release