LLMBOTTLENECK.COM
Hugging Face repository / answered by Qwen3.5-397B-A17B

prefeitura-rio/Rio-3.5-Open-397B: what it needs to run

prefeitura-rio/Rio-3.5-Open-397B is a fine-tune of Qwen/Qwen3.5-397B-A17B. Its configuration matches Qwen3.5-397B-A17B's on every field that decides memory, so Qwen3.5-397B-A17B's requirements are this repository's.

Answered by

Geometrypublished data. Both configurations are published files, read at the revisions named below and compared field by field. Not a test that the model loads.

Qwen3.5-397B-A17B (Qwen/Qwen3.5-397B-A17B) — every compared field is stated by both and equal.

Qwen3.5-397B-A17B: weight-file size by format

FormatSizeRangeBasis
FP16807.1 GB564.8 GB – 814.9 GBsize range
Q8_0429.0 GB300.0 GB – 434.8 GBsize range
Q6_K331.3 GB231.6 GB – 336.6 GBsize range
Q5_K_M288.2 GB194.1 GB – 336.6 GBsize range
Q5_0281.5 GB194.1 GB – 336.6 GBsize range
Q4_K_M247.6 GB158.8 GB – 336.6 GBsize range
Q4_0234.7 GB158.8 GB – 336.6 GBsize range
Q3_K_M201.7 GB121.3 GB – 336.6 GBsize range
Q2_K159.7 GB92.7 GB – 336.6 GBsize range

These are Qwen3.5-397B-A17B’s sizes. A model with the same geometry quantizes to the same size, to within any difference in parameter count noted above. Which devices hold each, and how fast they run it, is on Qwen3.5-397B-A17B’s page.

What was read, and where

  1. prefeitura-rio/Rio-3.5-Open-397B at revision 1d48ac22ae01 is tagged by its publisher as a fine-tune of Qwen/Qwen3.5-397B-A17B.
  2. prefeitura-rio/Rio-3.5-Open-397B/config.json at 1d48ac22ae01 was compared with Qwen/Qwen3.5-397B-A17B/config.json at 8472618112ab, the revision the catalogue pins: layers and their pattern, widths, head counts, experts, latent and recurrent dimensions, vocabulary, tied embeddings and any vision or audio tower.
Licence, as tagged
mit
Parameters in its safetensors index
403B
Task, as tagged
image-text-to-text
Last changed on Hugging Face
2026-07-24

Publishing this model? A badge for its card

The memory badge for this repository

[![Memory to run this model, from llmbottleneck.com](https://llmbottleneck.com/badge/prefeitura-rio/Rio-3.5-Open-397B)](https://llmbottleneck.com/hf/prefeitura-rio/Rio-3.5-Open-397B)

It states the memory to run the model at Q4_K_M with 8,192 tokens of context — built on this repository’s own Q4_K_M file when it publishes one — and links back to this page, where the evidence is.

Resolve another repository

The same answer as JSON: GET /v1/resolve?repo=prefeitura-rio/Rio-3.5-Open-397B, with a free key from /keys.

llmbottleneck
catalogue 2026-10-03models 327devices 135