tensor parallelism
1 article tagged with tensor parallelism
November 13, 2026
benchmarkNVIDIA
NVIDIA serves 753B-parameter GLM-5.3 NVFP4 on two DGX Stations, peaking at 607.8 tokens/s
NVIDIA published a tutorial for serving GLM-5.3 NVFP4, a 753-billion-parameter MoE model, across two GB300 DGX Stations with vLLM. In NVIDIA's AIPerf tests, output throughput peaked at 607.8 tokens per second at concurrency 16 and fell to 385.0 at concurrency 32.