Baidu · MoE Base Model

ERNIE 5.5 Flash Base

Baidu has released ERNIE 5.5 Flash Base, a raw pre-training checkpoint of a sparse 280B-parameter Mixture-of-Experts text model that activates 14B parameters per token. The weights stop at the end of pre-training, with no mid- or post-training applied, and it supports a 128K training context and 1M context for inference. Baidu reports the best score on 24 of 30 base-model benchmarks in its own pipeline, including MMLU-Pro at 78.4 against 69.2 for DeepSeek-V4-Flash-Base (self-reported). Weights are available in FP8 and BF16 on Hugging Face and ModelScope under the ERNIE 5.5 Flash Base License v1.0, which excludes the EU, UK and South Korea.