model release
Yandex Releases AliceAI-Foundation-80B-A3B-Base, an 80B-Parameter MoE Model with 262K Context
Yandex has released AliceAI-Foundation-80B-A3B-Base, an 80-billion-parameter hybrid MoE base model with 3 billion active parameters per token and a 262,144-token context window. The model was trained fully from scratch and, according to Yandex, outperforms larger open-source models on Russian-language factual and educational benchmarks.
3 min read