Key points
Xiaomi MiMo HySparse2 attention and cache reuse ｜ Prefill runs 25 layers and decode 49; each cross FA selects 1,024 global plus 128 recent tokens
Image source: @SemiAnalysis_
2026-11-08
Xiaomi MiMo Moves to a Causal Encoder-Decoder: Prefill Runs Only 25 of 49 Layers