LLMBOTTLENECK.COM
Hugging Face repository / answered by gemma-4-31B-it

google/gemma-4-31B-it-qat-q4_0-unquantized: what it needs to run

google/gemma-4-31B-it-qat-q4_0-unquantized is a fine-tune of google/gemma-4-31B-it. Its configuration matches gemma-4-31B-it's on every field that decides memory, so gemma-4-31B-it's requirements are this repository's.

Answered by

Geometrypublished data. Both configurations are published files, read at the revisions named below and compared field by field. Not a test that the model loads.

gemma-4-31B-it (google/gemma-4-31B-it) — every compared field is stated by both and equal.

Before you use those figures

  • Its safetensors index counts 32,682,372,656 parameters against the base's 31,273,088,876 (4.5% apart). The compared geometry is the same, so the difference is in weights this comparison does not cover, and the base's file sizes are off by about that share for this repository.

gemma-4-31B-it: weight-file size by format

FormatSizeRangeBasis
FP1663.1 GB60.3 GB – 64.0 GBreconstructed size
Q8_033.5 GB32.0 GB – 34.0 GBreconstructed size
Q6_K25.9 GB24.7 GB – 26.3 GBreconstructed size
Q5_K_M22.4 GB21.3 GB – 22.8 GBreconstructed size
Q5_021.9 GB20.7 GB – 22.2 GBreconstructed size
Q4_K_M19.2 GB18.0 GB – 19.6 GBreconstructed size
Q4_018.1 GB17.0 GB – 18.5 GBreconstructed size
Q3_K_M15.7 GB14.5 GB – 17.0 GBreconstructed size
Q2_K11.9 GB10.7 GB – 12.6 GBreconstructed size

These are gemma-4-31B-it’s sizes. A model with the same geometry quantizes to the same size, to within any difference in parameter count noted above. Which devices hold each, and how fast they run it, is on gemma-4-31B-it’s page.

What was read, and where

  1. google/gemma-4-31B-it-qat-q4_0-unquantized at revision 1e4d8beecacb is tagged by its publisher as a fine-tune of google/gemma-4-31B-it.
  2. google/gemma-4-31B-it-qat-q4_0-unquantized/config.json at 1e4d8beecacb was compared with google/gemma-4-31B-it/config.json at 842da3794eaa, the revision the catalogue pins: layers and their pattern, widths, head counts, experts, latent and recurrent dimensions, vocabulary, tied embeddings and any vision or audio tower.
Licence, as tagged
apache-2.0
Parameters in its safetensors index
33B
Task, as tagged
image-text-to-text
Last changed on Hugging Face
2026-07-20

Publishing this model? A badge for its card

The memory badge for this repository

[![Memory to run this model, from llmbottleneck.com](https://llmbottleneck.com/badge/google/gemma-4-31B-it-qat-q4_0-unquantized)](https://llmbottleneck.com/hf/google/gemma-4-31B-it-qat-q4_0-unquantized)

It states the memory to run the model at Q4_K_M with 8,192 tokens of context — built on this repository’s own Q4_K_M file when it publishes one — and links back to this page, where the evidence is.

Resolve another repository

The same answer as JSON: GET /v1/resolve?repo=google/gemma-4-31B-it-qat-q4_0-unquantized, with a free key from /keys.

llmbottleneck
catalogue 2026-10-03models 327devices 135