Nemotron-Labs-Diffusion-3B-Base: hardware requirements

Nemotron-Labs-Diffusion-3B-Base needs about 3.3 GB of memory at Q4 quantization — a 2.3 GB download plus room for context and overhead. That fits a machine with 8GB RAM.

Parameters
3.8B
Tier
Runs on a laptop
Licence
See model card
Released
2026-05-23

Will it run on your machine?

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Q4_K_Mrecommended2.3 GB3.3 GB6.3 GBestimated
Q5_K_M2.7 GB3.7 GB6.7 GBestimated
Q6_K3.1 GB4.1 GB7.2 GBestimated
Q8_04.1 GB5.0 GB8.1 GBestimated
BF167.7 GB8.9 GB12 GBestimated

“Measured” sizes are read from published GGUF files. “Estimated” sizes are derived from the parameter count and are typically within a few percent. The RAM columns add the context cache and runtime overhead to the download size.

Other sizes of Nemotron-Labs Diffusion 8B