Hy4 Flash Base

Tencent๐Ÿ‡จ๐Ÿ‡ณ China
active
Context window1049K tokens

Version History

flash-basemajor

Tencent released Hy4 Flash Base, a 220B-parameter MoE with 12B active parameters, text and image input, and a 1M-token context window. It introduces hybrid attention, LatentMoE and Engram n-gram embeddings relative to Hy4.

Benchmark Scores

Full leaderboard โ†’
BenchmarkScoreRankSource
MMLU-Pro71.1%62 of 76Hugging Face model card, Nov 2026 โ†—

Rank is against every model in our database with a sourced score on that benchmark, each counted once with its best score.

Coverage