Back to Nanbeige 4.3 33B in the gallery

BOSS Zhipin

Dense model for coding and tool-use agents, with a 52-layer Llama-style decoder and a 524,288-token context.

Nanbeige 4.3 33B architecture diagram
Nanbeige 4.3 33B architecture diagram. Select the diagram to view it at full size.

Architecture and specifications

Scale
33B parameters
Context (tokens)
524,288
Vocabulary
166,912 (~167k)
License
Apache License 2.0
Date
2026-10-24
Decoder type
Dense
Attention
GQA with RoPE
Layer mix
52 GQA
KV cache / token (bf16) info
208 KiB · High
Key detail
Uses 52 distinct decoder layers with 56 query heads, 8 KV heads, and untied input and output embeddings.

Training and benchmarks

Pretraining data
Not disclosed The model and base-model cards do not disclose the pretraining token count for Nanbeige4.3-33B-Base. Nanbeige 4.3 base model card · Nanbeige 4.3 model card
Post-training methods
Not disclosed The released chat model is derived from Nanbeige4.3-33B-Base, but its model card does not specify the post-training methods. Nanbeige 4.3 model card
AA Intelligence Index v5.0 info
Total score 20.4 Knowledge Work 32.7 Coding 18.3 Science 6.8 General 23.8

Further reading and tools