model release
Baidu open-sources ERNIE 5.5 Flash Base, an MoE model with 1M-token context for fine-tuning and inference
Baidu open-sourced ERNIE 5.5 Flash Base on November 5. It is a Mixture-of-Experts base model pretrained on 33.5 trillion tokens, with 128K pretraining context and up to 1M tokens in fine-tuning and inference. Baidu claims it sets state-of-the-art results among models of the same size.
3 min read