hybrid architecture

NVIDIA has released Nemotron-Labs-3-Puzzle-75B-A9B, a compressed variant of Nemotron-3-Super that reduces the model from 120.7B total/12.8B active parameters to 75.3B total/9.3B active parameters. According to NVIDIA, the model achieves approximately 2× higher server throughput on a single 8×B200 node and increases sustainable 1M-token single-H100 concurrency from 1 request to 8 requests while maintaining strong accuracy across benchmarks.

Liquid AI has released LFM2.5-230M, a 230M parameter hybrid model trained on 19 trillion tokens with a 32,768 token context window. The model achieves 213 tok/s decode speed on Galaxy S25 Ultra and 42 tok/s on Raspberry Pi 5, with support for function calling and data extraction tasks.