Ornith-1.0-9B: hardware requirements

Ornith-1.0-9B needs about 1.1 GB of memory at Q4 quantization — a 1 MB download plus room for context and overhead. That fits a machine with 8GB RAM.

Parameters
1M
Tier
Runs on a laptop
Licence
apache-2.0
Released
2026-06-29

Will it run on your machine?

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Q4_K_Mrecommended1 MB1.1 GB4.8 GBestimated
Q5_K_M1 MB1.1 GB4.8 GBestimated
Q6_K1 MB1.1 GB4.8 GBestimated
Q8_02 MB1.1 GB4.8 GBestimated
BF163 MB1.1 GB4.8 GBestimated

“Measured” sizes are read from published GGUF files. “Estimated” sizes are derived from the parameter count and are typically within a few percent. The RAM columns add the context cache and runtime overhead to the download size.

Other sizes of Ornith-1.0