AliceAI-Foundation-80B-A3B-Base

active
Context window262K tokens

Version History

80B-A3B-Basemajor

Yandex released AliceAI-Foundation-80B-A3B-Base, a new 80B-parameter (3B active) hybrid MoE base model trained from scratch with a 262K-token context window. The model claims strong performance on Russian factual knowledge benchmarks and competitive math/reasoning scores against larger open-source MoE models.

Benchmark Scores

Full leaderboard →
BenchmarkScoreRankSource
MMLU-Pro66.8%64 of 73Hugging Face model card ↗
LiveCodeBench50.5%42 of 48Hugging Face model card ↗
AIME 202696.7%3 of 26Hugging Face model card ↗

Rank is against every model in our database with a sourced score on that benchmark, each counted once with its best score.

Coverage

model release

Yandex Releases AliceAI-Foundation-80B-A3B-Base, an 80B-Parameter MoE Model with 262K Context

Yandex has released AliceAI-Foundation-80B-A3B-Base, an 80-billion-parameter hybrid MoE base model with 3 billion active parameters per token and a 262,144-token context window. The model was trained fully from scratch and, according to Yandex, outperforms larger open-source models on Russian-language factual and educational benchmarks.

3 min read