NVIDIA-Nemotron-3.5-Bolt-E4B-4GB: hardware requirements

NVIDIA-Nemotron-3.5-Bolt-E4B-4GB needs about 7.6 GB of memory at Published quantization: a 6.2 GB download plus room for context and a runtime allowance. That fits a machine with 16GB RAM.

Parameters
4B
Tier
Runs on a laptop
Licence
See model card
Released
2026-10-07

Will it run on your machine?

Download sizes by quantization

Lower quantization means a smaller file and less memory, at some cost to quality. Q4_K_M is the usual starting point. What is this?

QuantDownloadRAM @ 4KRAM @ 32KSource
Published6.2 GB7.6 GB7.6 GBnvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB

Download sizes are measured from the published files named in the Source column. The RAM columns add the context cache, calculated from the model's configuration, and a runtime allowance of 10% of the download (at least 0.5GB, at most 3GB).

Other sizes of NVIDIA-Nemotron-3.5-Bolt

Model card on HuggingFace →API specs & pricing →Verified 2026-10-23Listed for 120 days after release