Architecture
Retrieved 2026-09-01 at pinned commit cd97f59135f3; parameter count from the safetensors index at the same revision.
- Architecture
- minimax_m2
- Layers
- 62
- Hidden size
- 3,072
- Attention heads
- 48
- KV heads
- 8
- Head dimension
- 128
- Feed-forward width
- 1,536
- Vocabulary
- 200,064
- Context ceiling
- 196,608
- RoPE theta
- 5,000,000
- Experts
- 256
- Experts / token
- 8
- Shared expert width
- 0
Where the memory goes
Grouped-query attention shares each key/value head across 6 query heads, so the KV cache is 17% of what multi-head attention would need at the same context.