farbodtavakkoli / gemma3_text

OTel-LLM-27B-IT

Name: OTel-LLM-27B-IT architecture and memory requirements
Creator: LLM Bottleneck
License: https://creativecommons.org/licenses/by/4.0/

Parameter count not published.

Architecturepublished data

Architecture available · weight sizes unavailable

Weight sizeno data

This snapshot holds OTel-LLM-27B-IT’s architecture but no weight size for any format, so the calculator cannot answer for it and it has no hardware table.

Why: Neither a published artifact nor a published parameter count exists for this model at its pinned revision. A size is never inferred from the model’s name.

The coverage page explains what the catalogue does not size, and why.

Under the hood

Architecture, read from the publisher’s file

The numbers every figure above is computed from, with the file they came from.

Architecture

architecture.json · pinned 62a522b2dcb8

✓ Architecture read from the published config.json

Retrieved 2026-09-01 at pinned commit 62a522b2dcb8.

Architecture: gemma3_text
Layers: 62
Hidden size: 5,376
Attention heads: 32
KV heads: 16
Head dimension: 128
Feed-forward width: 21,504
Vocabulary: 262,208
Context ceiling: 131,072
Sliding window: 1,024
RoPE theta: 1,000,000

Where the memory goes

Grouped-query attention shares each key/value head across 2 query heads, so the KV cache is 50% of what multi-head attention would need at the same context.

This is a multimodal checkpoint (vision); the diagram and memory sizing above cover the text decoder. Encoder/audio/image activations are not included in the KV or weight figures.

Open the exact official config.json ↗

More from farbodtavakkoli

OTel-2.0-LLM-31B-IT OTel-LLM-E4B-IT

Citing this page

LLM Bottleneck. “OTel-LLM-27B-IT VRAM and hardware requirements.” Architecture from farbodtavakkoli/OTel-LLM-27B-IT at revision 62a522b2dcb8, retrieved 2026-09-01. https://llmbottleneck.com/models/farbodtavakkoli-otel-llm-27b-it

Every figure above is either the published value or a reconstruction whose measured error is on the accuracy page.