TPSTokens Per Second

tiny-aya-global: hardware requirements

tiny-aya-global needs about 2.9 GB of memory at Q4 quantization — a 2.1 GB download plus room for context and overhead. That fits a machine with 8GB RAM.

Parameters
3.3B
Tier
Runs on a laptop
Licence
See model card
Released
2026-02-13

Will it run on your machine?

8GB RAMRuns well16GB RAMRuns well24GB RAMRuns well32GB RAMRuns well64GB RAMRuns well128GB RAMRuns well8GB VRAMRuns well12GB VRAMRuns well16GB VRAMRuns well24GB VRAMRuns well32GB VRAMRuns well

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Q4_K_Mrecommended2.1 GB2.9 GB2.9 GBmeasured
Q5_K_M2.4 GB3.2 GB3.2 GBestimated
Q6_K2.7 GB3.6 GB3.6 GBestimated
Q8_03.6 GB4.5 GB4.5 GBmeasured
BF166.7 GB8.2 GB8.2 GBmeasured

“Measured” sizes are read from published GGUF files (CohereLabs/tiny-aya-global-GGUF). “Estimated” sizes are derived from the parameter count and are typically within a few percent. The RAM columns add the context cache and runtime overhead to the download size.

Model card on HuggingFace →API specs & pricing →Verified 2026-09-13Tracked for 12 months after release