Architecture
Retrieved 2026-09-01 at pinned commit 98fbd955b034.
- Architecture
- needle
- Layers
- 27
- Hidden size
- 512
- Attention heads
- 8
- KV heads
- 4
- Head dimension
- 64
- Vocabulary
- 8,192
- Context ceiling
- 2,048
- Sliding window
- 256
- RoPE theta
- 100,000
LLM//BOTTLENECK
Parameter count not published.
This snapshot holds needle2’s architecture but no weight size for any format, so the calculator cannot answer for it and it has no hardware table.
Why: Neither a published artifact nor a published parameter count exists for this model at its pinned revision. A size is never inferred from the model’s name.
The coverage page explains what the catalogue does not size, and why.
The numbers every figure above is computed from, with the file they came from.
Retrieved 2026-09-01 at pinned commit 98fbd955b034.
LLM Bottleneck. “needle2 VRAM and hardware requirements.” Architecture from Cactus-Compute/needle2 at revision 98fbd955b034, retrieved 2026-09-01. https://llmbottleneck.com/models/cactus-compute-needle2
Every figure above is either the published value or a reconstruction whose measured error is on the accuracy page.