Back to Ling 2.6 1T in the gallery

InclusionAI

Ling 2.5 successor that keeps the Lightning Attention and MLA hybrid stack while adding an MTP layer for multi-token prediction.

Ling 2.6 1T architecture diagram
Ling 2.6 1T architecture diagram. Select the diagram to view it at full size.

Architecture and specifications

Scale
1T total, 63B active (6.3% active)
Context (tokens)
262,144
License
MIT License
Date
2026-04-23
Decoder type
Sparse hybrid
Attention
Lightning Attention plus MLA
Layer mix
10 MLA + 70 Lightning Attention + 1 MTP layer
KV cache / token (bf16) info
11.2 KiB · Very low
Key detail
Keeps the 7:1 linear-attention/MLA ratio and adds one multi-token-prediction layer for speculative decoding.

Training and benchmarks

Pretraining data
~9.6T additional tokens Architectural migration and continued pretraining from the Ling 2.0 base; the inherited base training is separate from this budget. Technical report
Post-training methods
SFT, RLVR, Distillation SFT and specialist RL include verifiable reasoning and tool-use rewards. Specialist capabilities are then distilled into a unified Ling 2.6 model. Technical report
AA Intelligence Index v4.3.2 info
Total score 17.0 General N/A Scientific 4.5 Coding N/A Agents N/A

Further reading and tools