How much RAM does harrier-oss-v1-270m need?

harrier-oss-v1-270m needs about 865 MB of memory at Q4_K_M quantization with 4K context. The download itself is 253 MB; the extra covers the context cache and runtime overhead.

Can I run harrier-oss-v1-270m on a laptop?

Yes — it runs comfortably on a machine with 8GB RAM, for example Base MacBook Air (M1/M2).

harrier-oss-v1-270m: hardware requirements

harrier-oss-v1-270m needs about 865 MB of memory at Q4 quantization — a 253 MB download plus room for context and overhead. That fits a machine with 8GB RAM.

Parameters

268M

Tier

Runs on a laptop

Licence

See model card

Released

2026-03-31

Will it run on your machine?

8GB RAMRuns well 16GB RAMRuns well 24GB RAMRuns well 32GB RAMRuns well 64GB RAMRuns well 128GB RAMRuns well 8GB VRAMRuns well 12GB VRAMRuns well 16GB VRAMRuns well 24GB VRAMRuns well 32GB VRAMRuns well

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

Quant	Download	RAM @ 4K	RAM @ 32K	Source
Q4_K_Mrecommended	253 MB	865 MB	1.4 GB	measured
Q5_K_M	260 MB	872 MB	1.4 GB	measured
Q6_K	283 MB	895 MB	1.4 GB	measured
Q8_0	292 MB	904 MB	1.4 GB	measured
BF16	543 MB	1.2 GB	1.7 GB	measured

“Measured” sizes are read from published GGUF files (mykor/harrier-oss-v1-270m-GGUF). “Estimated” sizes are derived from the parameter count and are typically within a few percent. The RAM columns add the context cache and runtime overhead to the download size.

Model card on HuggingFace →API specs & pricing →Verified 2026-08-09Tracked for 12 months after release