Back to Qwen3.6 35B-A3B in the gallery

Alibaba Cloud

Compact Qwen3.6 open-weight MoE that keeps the Qwen3.5 hybrid Gated DeltaNet/Gated Attention recipe while activating only about 3B parameters.

Qwen3.6 35B-A3B architecture diagram
Qwen3.6 35B-A3B architecture diagram. Select the diagram to view it at full size.

Architecture and specifications

Scale
35B total, 3B active (8.6% active)
Context (tokens)
262,144 native (1,010,000 with YaRN)
License
Apache License 2.0
Date
2026-04-15
Decoder type
Sparse hybrid
Attention
3:1 Gated DeltaNet and gated attention with GQA
Layer mix
10 gated attention + 30 DeltaNet
KV cache / token (bf16) info
20 KiB · Very low
Key detail
Uses 256 experts with 8 routed plus 1 shared expert active inside a 40-layer hybrid stack.

Training and benchmarks

Pretraining data
Not disclosed The model card does not report the pretraining token count. Model card
Post-training methods
Not disclosed The card identifies a post-trained checkpoint without naming the methods. Model card
AA Intelligence Index v4.3.2 info
Total score 18.2 General 28.7 Scientific 11.3 Coding 18.3 Agents 12.7

Further reading and tools