NVIDIA lifts Ling-3.0-flash GSM8K decode throughput 42.5% on a single DGX Spark with 3 MoE optimizations
NVIDIA describes 3 stacked optimizations for Mixture-of-Experts (MoE) inference on a single DGX Spark. On Ant Group inclusionAI's 124B Ling-3.0-flash, GSM8K decode throughput rose 42.5% with no detectable accuracy change.
NVIDIA has shown how 3 stacked optimizations speed up Mixture-of-Experts (MoE) inference on a single DGX Spark. On Ant Group inclusionAI's 124B Ling-3.0-flash, GSM8K decode throughput rose 42.5% with no detectable accuracy change, according to a MarkTechPost report published November 3, 2026.
Key figures
- Hardware: a single NVIDIA DGX Spark
- Model: Ling-3.0-flash from Ant Group inclusionAI, 124B parameters
- Benchmark: GSM8K, decode throughput
- Result: 42.5% higher throughput
- Accuracy: no detectable change
The optimizations are described as stacked, meaning they are applied together to reach the reported gain. The 42.5% figure is the result NVIDIA reports for the combined set on this model and benchmark.
What this means
The result is a decode throughput gain on a 124B MoE model running on one DGX Spark, measured on GSM8K. The report states accuracy did not change in any detectable way, so the speedup was not traded against GSM8K quality. The 42.5% figure applies to the model, hardware and benchmark named above.
Related Articles
NVIDIA NemoClaw blueprints bundle Nemotron, NeMo tools and OpenShell for three agent harnesses
NVIDIA published NemoClaw, a set of open blueprints that assemble a tuned agent harness, Nemotron models, NeMo optimization tools and the OpenShell secure runtime. The blueprints currently support OpenClaw, Hermes Agent and LangChain Deep Agents. LangChain says its tuned Deep Agents harness brings Nemotron 3 Ultra to near-frontier performance at approximately 10x lower cost per run.
NVIDIA and MIT team releases Open-H3-Regenerate-2K, regenerating MiniMax H3 video drafts at up to native 4K
The Efficient-Large-Model team, made up of NVIDIA and MIT researchers, released Open-H3-Regenerate-2K weights on Hugging Face. Built on MiniMax H3, it regenerates low-resolution video drafts at 2560×1440 and up to native 3840×2160. The team reports a 3.9x speedup on a single B200 and a higher UniPercept score than the official H3-Regenerate-2K API.
NVIDIA Nemotron 3.5 Bolt E4B: 8B-parameter Gemma 4 post-train with 64K context for local assistants
NVIDIA released Nemotron-3.5-Bolt-E4B-4GB on 2026-10-23, a small language model post-trained from Gemma-4-E4B-it with 8B total (4B effective) parameters and 64K-token input and output. It targets local voice and device assistants. Unsloth now lists a GGUF build of the model on Hugging Face.
NVIDIA Nemotron 3.5 Transcribe: open 30B model handles 40 languages, diarization and translation
NVIDIA released Nemotron 3.5 Transcribe, an open-weight, promptable speech model that transcribes 40 languages, translates 31 to or from English and labels speakers in 13. It is available on Hugging Face and ModelScope alongside Granary v2 data and NeMo Speech fine-tuning recipes.
Comments
Loading...