Nanbeige 4.3 33B Architecture
Back to Nanbeige 4.3 33B in the gallery
BOSS Zhipin
Dense model for coding and tool-use agents, with a 52-layer Llama-style decoder and a 524,288-token context.
Architecture and specifications
- Scale
- 33B parameters
- Context (tokens)
- 524,288
- Vocabulary
- 166,912 (~167k)
- License
- Apache License 2.0
- Date
- 2026-10-24
- Decoder type
- Dense
- Attention
- GQA with RoPE
- Layer mix
- 52 GQA
- KV cache / token (bf16) info
- 208 KiB · High
- Key detail
- Uses 52 distinct decoder layers with 56 query heads, 8 KV heads, and untied input and output embeddings.
Training and benchmarks
- Pretraining data
- Not disclosed The model and base-model cards do not disclose the pretraining token count for Nanbeige4.3-33B-Base. Nanbeige 4.3 base model card · Nanbeige 4.3 model card
- Post-training methods
- Not disclosed The released chat model is derived from Nanbeige4.3-33B-Base, but its model card does not specify the post-training methods. Nanbeige 4.3 model card