Ling 2.6 1T Architecture
Back to Ling 2.6 1T in the gallery
InclusionAI
Ling 2.5 successor that keeps the Lightning Attention and MLA hybrid stack while adding an MTP layer for multi-token prediction.
Architecture and specifications
- Scale
- 1T total, 63B active (6.3% active)
- Context (tokens)
- 262,144
- License
- MIT License
- Date
- 2026-04-23
- Decoder type
- Sparse hybrid
- Attention
- Lightning Attention plus MLA
- Layer mix
- 10 MLA + 70 Lightning Attention + 1 MTP layer
- KV cache / token (bf16) info
- 11.2 KiB · Very low
- Key detail
- Keeps the 7:1 linear-attention/MLA ratio and adds one multi-token-prediction layer for speculative decoding.
Training and benchmarks
- Pretraining data
- ~9.6T additional tokens Architectural migration and continued pretraining from the Ling 2.0 base; the inherited base training is separate from this budget. Technical report
- Post-training methods
- SFT, RLVR, Distillation SFT and specialist RL include verifiable reasoning and tool-use rewards. Specialist capabilities are then distilled into a unified Ling 2.6 model. Technical report