base-model

Yandex has released AliceAI-Foundation-80B-A3B-Base, an 80-billion-parameter hybrid MoE base model with 3 billion active parameters per token and a 262,144-token context window. The model was trained fully from scratch and, according to Yandex, outperforms larger open-source models on Russian-language factual and educational benchmarks.

DeepSeek has released V4-Flash-Base, a 292 billion parameter base model now available on Hugging Face. The model uses BF16, I64, F32, and F8_E4M3 tensor types and is distributed in Safetensors format.

DeepSeek has released DeepSeek-V4-Pro-Base, a 1.6 trillion parameter foundation model now available on Hugging Face. The base model uses BF16 precision for weights and includes support for F8_E4M3, I64, and F32 tensor types.