NVIDIA Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4

NVIDIA🇺🇸 United States
active
Context window1000K tokens

Version History

Puzzle-75B-A9B-NVFP4major

Compressed variant of Nemotron-3-Super reduced from 120.7B/12.8B active to 75.3B/9.3B active parameters using Iterative Puzzle framework. Achieves 2× throughput and 8× H100 concurrency while maintaining benchmark accuracy.

Benchmark Scores

Full leaderboard →
78.0%
GPQA
79.9%
LiveCodeBench
82.2%
MMLU-Pro

Coverage

model releaseNVIDIA

NVIDIA releases Nemotron-Labs-3-Puzzle-75B, compressed from 120B to 75B parameters with 2× throughput

NVIDIA has released Nemotron-Labs-3-Puzzle-75B-A9B, a compressed variant of Nemotron-3-Super that reduces the model from 120.7B total/12.8B active parameters to 75.3B total/9.3B active parameters. According to NVIDIA, the model achieves approximately 2× higher server throughput on a single 8×B200 node and increases sustainable 1M-token single-H100 concurrency from 1 request to 8 requests while maintaining strong accuracy across benchmarks.

2 min read