GLM-5.1 Architecture
Back to GLM-5.1 in the gallery
Z.ai
Post-trained GLM refresh that keeps the GLM-5 backbone intact but targets stronger long-horizon agentic coding.
Architecture and specifications
- Scale
- 744B total, 40B active (5.4% active)
- Context (tokens)
- 202,752
- License
- MIT License
- Date
- 2026-04-07
- Decoder type
- Sparse MoE
- Attention
- MLA with DeepSeek Sparse Attention
- Layer mix
- 78 MLA/DSA
- KV cache / token (bf16) info
- 107.25 KiB · Moderate
- Key detail
- Architecture stays aligned with GLM-5, including its MTP-capable backbone; the main shift is post-training.
Training and benchmarks
- Pretraining data
- Not disclosed The official model card does not give a version-specific pretraining-token total. GLM-5.1 model card
- Post-training methods
- Not disclosed The official model card and documentation do not itemize version-specific training stages. GLM-5.1 documentation