GLM-4.5-Air Architecture
Back to GLM-4.5-Air in the gallery
Z.ai
Compact GLM-4.5 companion that keeps the same agent-oriented sparse MoE recipe at a smaller serving footprint.
Architecture and specifications
- Scale
- 106B total, 12B active (11.3% active)
- Context (tokens)
- 131,072
- License
- MIT License
- Date
- 2025-07-28
- Decoder type
- Sparse MoE
- Attention
- GQA
- Layer mix
- 46 GQA
- KV cache / token (bf16) info
- 184 KiB · High
- Key detail
- Shrinks the GLM-4.5 layout to 46 layers, keeps the dense warmup, and inherits the MTP training recipe.
Training and benchmarks
- Pretraining data
- Not disclosed The report gives 23T tokens for GLM-4.5 but does not separately establish Air's budget. GLM-4.5 report
- Post-training methods
- SFT, RLVR, RLHF, RLAIF, Distillation The series recipe combines SFT, expert RL with rule-based, human, and AI feedback, and expert distillation. GLM-4.5 report