Nemotron 3.5 Lightning

NVIDIA🇺🇸 United States
active
Context window1000K tokens
Input / 1M tokens$0.1
Output / 1M tokens$0.25

Version History

3.5 Lightningmajor

Nemotron 3.5 Lightning succeeds Nemotron 3 Nano 30B A3B, gaining nine points on the Intelligence Index (15 to 24) and large jumps on agentic benchmarks (GDPval-AA v2 Elo up 334 points, Terminal-Bench v2.1 up from 7% to 24.3%) while becoming the fastest model in its comparison class at nearly 670 tokens per second.

3.5-Lightning-30B-A3B-BF16minor

NVIDIA released the full-precision BF16 reference weights for Nemotron 3.5 Lightning, a 30B-parameter hybrid Mamba-MoE-Attention model with 3B active parameters and up to 1M token context. This release is intended for fine-tuning and quantization rather than direct deployment, with a companion NVFP4 checkpoint available for optimized inference.

3.5-Lightning-30B-A3B-NVFP4major

NVIDIA released a new NVFP4-quantized checkpoint of Nemotron 3.5 Lightning, a 30B-total/3B-active hybrid Mamba-2/MoE/Attention model with 1M-token context, optimized for single-GPU deployment on DGX Spark or H100 hardware. The release includes post-training quantization and speculative decoding support to preserve BF16-level accuracy at lower inference cost.

Benchmark Scores

Full leaderboard →
1353.0 elo
Arena Elo
75.6%
GPQA
81.9%
MMLU-Pro
321.8 tokens_per_sec
Speed (tok/s)
52.8%
SWE-bench Verified

Coverage

model releaseNVIDIA

NVIDIA Releases Nemotron 3.5 Lightning: 30B MoE Model with 1M Token Context and 3B Active Parameters

NVIDIA released the full-precision BF16 reference weights for Nemotron 3.5 Lightning, a 30B-parameter Mixture-of-Experts model with only 3B active parameters and support for up to 1 million tokens of context. The model uses a hybrid Mamba-2, MoE, and Attention architecture and is licensed under OpenMDW-1.1 for commercial use.

2 min read
model releaseNVIDIA

NVIDIA Releases Nemotron 3.5 Lightning 30B-A3B: 3B-Active MoE Model With 1M-Token Context, Quantized for Single-GPU Depl

NVIDIA has published NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4, a 30-billion-parameter Mixture-of-Experts model with only 3B active parameters, a hybrid Mamba-2/MoE/Attention architecture, and support for up to 1 million tokens of context. The NVFP4-quantized checkpoint is designed to run on a single DGX Spark (GB10) or H100 GPU.

2 min read
model releaseNVIDIA

Nvidia Releases Nemotron 3.5 Lightning: A 31.6B-Parameter Open Model Built for Speed, Not Peak Intelligence

Nvidia's Nemotron 3.5 Lightning, a 31.6B-parameter open-weight model with only 3.6B active parameters, matches OpenAI's gpt-oss-120b on the Artificial Analysis Intelligence Index while delivering the fastest throughput in its class at nearly 670 tokens per second. The model posts especially large gains on agentic benchmarks, beating both gpt-oss-120b and the larger Nemotron 3 Super.

3 min read