Qwen3.6 35B-A3B Architecture
Back to Qwen3.6 35B-A3B in the gallery
Alibaba Cloud
Compact Qwen3.6 open-weight MoE that keeps the Qwen3.5 hybrid Gated DeltaNet/Gated Attention recipe while activating only about 3B parameters.
Architecture and specifications
- Scale
- 35B total, 3B active (8.6% active)
- Context (tokens)
- 262,144 native (1,010,000 with YaRN)
- License
- Apache License 2.0
- Date
- 2026-04-15
- Decoder type
- Sparse hybrid
- Attention
- 3:1 Gated DeltaNet and gated attention with GQA
- Layer mix
- 10 gated attention + 30 DeltaNet
- KV cache / token (bf16) info
- 20 KiB · Very low
- Key detail
- Uses 256 experts with 8 routed plus 1 shared expert active inside a 40-layer hybrid stack.
Training and benchmarks
- Pretraining data
- Not disclosed The model card does not report the pretraining token count. Model card
- Post-training methods
- Not disclosed The card identifies a post-trained checkpoint without naming the methods. Model card