Xiaomi MiMo-V2.6-Flash-RL 309B Architecture
Back to Xiaomi MiMo-V2.6-Flash-RL 309B in the gallery
Xiaomi
Omnimodal sparse MoE model with the MiMo-V2.5 text backbone, mixed-domain reinforcement learning, and a five-layer DFlash speculative decoder.
Architecture and specifications
- Scale
- 309B total, 15B active (4.9% active)
- Context (tokens)
- 1,048,576
- Vocabulary
- 152,576 (~152k)
- License
- MIT License
- Date
- 2026-09-21
- Decoder type
- Sparse omnimodal MoE
- Attention
- GQA with sliding-window/global attention
- Layer mix
- 39 sliding-window + 9 global
- KV cache / token (bf16) info
- 217.5 KiB · High
- Key detail
- Uses 256 routed experts with top-8 routing, one dense prefix layer, no shared experts, and a 128-token sliding window.
Training and benchmarks
- Pretraining data
- 48T tokens 26T text-stage tokens plus 22T omni-stage tokens. Technical report
- Post-training methods
- SFT, RLVR, Distillation Short SFT, mixed-task GRPO using tests and agentic graders, and MOPD2 distillation described in the series recipe. Technical report