Architecture
Retrieved 2026-09-01 at pinned commit a7351bf2bee0; parameter count from the safetensors index at the same revision.
- Architecture
- minimax_text_01
- Layers
- 80
- Hidden size
- 6,144
- Attention heads
- 64
- KV heads
- 8
- Head dimension
- 128
- Feed-forward width
- 9,216
- Vocabulary
- 200,064
- Context ceiling
- 10,240,000
- RoPE theta
- 10,000,000
- Experts
- 32
- Experts / token
- 2
- Shared expert width
- 0
Where the memory goes
Grouped-query attention shares each key/value head across 8 query heads, so the KV cache is 13% of what multi-head attention would need at the same context.