throughput

The China Academy of Information and Communications Technology (CAICT) reports that the normalized average price of domestic models rose from 6.8 yuan to 13.46 yuan, an increase of almost 100 percent. Daily token consumption in China reached about 500 trillion in June 2026, nearly four times the December 2025 level.

Alibaba's Qwen team has launched Qwen3.8 Max Prime, a separate high-throughput SKU of its flagship Qwen3.8 Max model. It carries the same 1M-token context window and multimodal capabilities as the base model but at double the price.

Taalas, a new Canadian hardware startup, announced its first product: a custom silicon implementation of Meta's Llama 3.1 8B model running at 17,000 tokens/second. The startup uses aggressive quantization combining 3-bit and 6-bit parameters. The system is accessible via chatjimmy.ai.