Model directory / 327 pinned architectures

Find a local model

Compare sizes and context limits, then open one in the calculator. Every model page links the exact config.json it was read from.

Filtersno filters applied

More filters · publisher, context, architecture, published files

PublisherContext windowArchitectureHas a published GGUF file

Mixture-of-experts models route each token through a few experts, so they read fewer bytes per token than their size suggests but still need the whole file in memory.

327 models from 82 publishers · 327 in the catalogue

Ordered by Hugging Face's 30-day download count, read 2026-10-03: a popularity signal, not a measure of quality. Models without a count come last. File sizes are the weight file at the format shown, not the whole memory a run needs.

Qwenqwen3
Qwen3-0.6B
Parameters
752M
Context
40K
Q4_K_M file
0.48 GB
Q4_K_Mreconstructed size29.7M downloads / 30dCalculator →
Qwenqwen3_vl_text
Qwen3-VL-8B-Instruct
Parameters
8.8B
Context
256K
Q4_K_M file
5.03 GB
Q4_K_Mpublished data14.6M downloads / 30dCalculator →
Googlegemma4_textMoE, 128 experts
gemma-4-26B-A4B-it
Parameters
26B
Context
256K
Q4_K_M file
15.4 GB
Q4_K_Mreconstructed size13M downloads / 30dCalculator →
Qwenqwen3
Qwen3-8B
Parameters
8.2B
Context
40K
Q4_K_M file
5.03 GB
Q4_K_Mpublished data10.7M downloads / 30dCalculator →
Googlegemma4_text
gemma-4-31B-it
Parameters
31B
Context
256K
Q4_K_M file
19.2 GB
Q4_K_Mreconstructed size9.9M downloads / 30dCalculator →
Qwenqwen3_5_text
Qwen3.5-9B
Parameters
9.7B
Context
256K
Q4_K_M file
3.80 GB–10.4 GB
Q4_K_Msize range9M downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-0.5B-Instruct
Parameters
494M
Context
32K
Q4_K_M file
0.41 GB
Q4_K_Mreconstructed size8.7M downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-7B-Instruct
Parameters
7.6B
Context
32K
Q4_K_M file
4.68 GB
Q4_K_Mpublished data8.4M downloads / 30dCalculator →
Qwenqwen3_5_text
Qwen3.5-4B
Parameters
4.7B
Context
256K
Q4_K_M file
1.83 GB–5.37 GB
Q4_K_Msize range7.8M downloads / 30dCalculator →
Qwenqwen3
Qwen3-4B
Parameters
4.0B
Context
40K
Q4_K_M file
2.50 GB
Q4_K_Mpublished data7.8M downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-1.5B-Instruct
Parameters
1.5B
Context
32K
Q4_K_M file
1.12 GB
Q4_K_Mreconstructed size7.4M downloads / 30dCalculator →
Qwenqwen3_5_text
Qwen3.8-27B
Parameters
28B
Context
256K
Q4_K_M file
10.9 GB–26.0 GB
Q4_K_Msize range6.9M downloads / 30dCalculator →
OpenAIgpt_ossMoE, 32 experts
gpt-oss-20b
Parameters
21B
Context
128K
Q4_K_M file
12.8 GB
Q4_K_Mreconstructed size6.6M downloads / 30dCalculator →
Qwenqwen2_5_vl
Qwen2.5-VL-7B-Instruct
Parameters
8.3B
Context
125K
Q4_K_M file
3.27 GB–8.16 GB
Q4_K_Msize range5.8M downloads / 30dCalculator →
zai-orgglm5_next_textMoE, 288 experts
GLM-5.3-Flash
Parameters
321B
Context
1M
Q4_K_M file
126.5 GB–267.7 GB
Q4_K_Msize range5.4M downloads / 30dCalculator →
Qwenqwen3_5_text
Qwen3.5-2B
Parameters
2.3B
Context
256K
Q4_K_M file
0.90 GB–3.10 GB
Q4_K_Msize range4.9M downloads / 30dCalculator →
dphnllama
dolphin-2.9.1-yi-1.5-34b
Parameters
34B
Context
8K
Q4_K_M file
20.7 GB
Q4_K_Mreconstructed size4.7M downloads / 30dCalculator →
DeepSeekdeepseek_v4MoE, 256 experts
DeepSeek-V4-Flash-0731
Parameters
304B checkpoint · DSpark attached
Context
1M
Q4_K_M file
119.7 GB–253.1 GB
Q4_K_Msize range4.5M downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
OpenAIgpt_ossMoE, 128 experts
gpt-oss-120b
Parameters
117B
Context
128K
Q4_K_M file
70.8 GB
Q4_K_Mreconstructed size4.5M downloads / 30dCalculator →
Googlegemma4_text
gemma-4-E4B-it
Parameters
8.0B
Context
128K
Q4_K_M file
3.15 GB–8.22 GB
Q4_K_Msize range4.4M downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-3B-Instruct
Parameters
3.1B
Context
32K
Q4_K_M file
2.10 GB
Q4_K_Mreconstructed size4.2M downloads / 30dCalculator →
Qwenqwen3
Qwen3-32B
Parameters
33B
Context
40K
Q4_K_M file
19.8 GB
Q4_K_Mpublished data4M downloads / 30dCalculator →
Qwenqwen3
Qwen3-4B-Instruct-2507
Parameters
4.0B
Context
256K
Q4_K_M file
2.72 GB
Q4_K_Mreconstructed size3.7M downloads / 30dCalculator →
DeepSeekdeepseek_v32MoE, 256 experts
DeepSeek-V3.2
Parameters
685B
Context
160K
Q4_K_M file
269.9 GB–570.0 GB
Q4_K_Msize range3.6M downloads / 30dCalculator →
Qwenqwen3_vl_text
Qwen3-VL-4B-Instruct
Parameters
4.4B
Context
256K
Q4_K_M file
2.72 GB
Q4_K_Mreconstructed size3.5M downloads / 30dCalculator →
EleutherAIgpt_neox
pythia-160m
Parameters
213M
Context
2K
Q4_K_M file
0.08 GB–0.27 GB
Q4_K_Msize range3.5M downloads / 30dCalculator →
NVIDIAnemotron_h
NVIDIA-Nemotron-3-Nano-4B-BF16
Parameters
4.0B
Context
256K
Q4_K_M file
1.56 GB–4.27 GB
Q4_K_Msize range3.4M downloads / 30dCalculator →
Qwenqwen3_5_moe_textMoE, 256 experts
Qwen3.6-35B-A3B
Parameters
36B
Context
256K
Q4_K_M file
14.2 GB–31.0 GB
Q4_K_Msize range3.3M downloads / 30dCalculator →
Qwenqwen3
Qwen3-1.7B
Parameters
2.0B
Context
40K
Q4_K_M file
1.28 GB
Q4_K_Mreconstructed size3.1M downloads / 30dCalculator →
Googlegemma4_text
gemma-4-E2B-it
Parameters
5.1B
Context
128K
Q4_K_M file
2.02 GB–5.21 GB
Q4_K_Msize range3M downloads / 30dCalculator →
farbodtavakkoligemma4
OTel-2.0-LLM-31B-IT
Parameters
31B
Context
256K
Q4_K_M file
19.2 GB
Q4_K_Mreconstructed size3M downloads / 30dCalculator →
Qwenqwen3_vl_text
Qwen3-VL-2B-Instruct
Parameters
2.1B
Context
256K
Q4_K_M file
0.84 GB–2.50 GB
Q4_K_Msize range2.8M downloads / 30dCalculator →
Qwenqwen3
Qwen3-14B
Parameters
15B
Context
40K
Q4_K_M file
9.00 GB
Q4_K_Mpublished data2.7M downloads / 30dCalculator →
Qwenqwen3_5_text
Qwen3.5-0.8B
Parameters
873M
Context
256K
Q4_K_M file
0.34 GB–1.33 GB
Q4_K_Msize range2.6M downloads / 30dCalculator →
CMSManhattanqwen2
JiRackUltra_1b
Parameters
1.8B
Context
128K
Q4_K_M file
1.12 GB
Q4_K_Mreconstructed size2.5M downloads / 30dCalculator →
Qwenqwen3_5_text
Qwen3.6-27B
Parameters
28B
Context
256K
Q4_K_M file
10.9 GB–26.0 GB
Q4_K_Msize range2.5M downloads / 30dCalculator →
Qwenqwen2_5_vl
Qwen2.5-VL-3B-Instruct
Parameters
3.8B
Context
125K
Q4_K_M file
1.48 GB–3.85 GB
Q4_K_Msize range2.4M downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-Coder-7B-Instruct
Parameters
7.6B
Context
32K
Q4_K_M file
4.68 GB
Q4_K_Mreconstructed size2.3M downloads / 30dCalculator →
Mistral AImistral
Mistral-7B-Instruct-v0.3
Parameters
7.2B
Context
32K
Q4_K_M file
4.37 GB
Q4_K_Mreconstructed size2.2M downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-32B-Instruct
Parameters
33B
Context
32K
Q4_K_M file
19.9 GB
Q4_K_Mpublished data1.9M downloads / 30dCalculator →
Googlegemma4_unified_text
gemma-4-12B-it
Parameters
12B
Context
256K
Q4_K_M file
7.87 GB
Q4_K_Mreconstructed size1.9M downloads / 30dCalculator →
Qwenqwen3_5_text
Qwen3.5-27B
Parameters
28B
Context
256K
Q4_K_M file
10.9 GB–26.0 GB
Q4_K_Msize range1.9M downloads / 30dCalculator →
HuggingFaceTBllama
SmolLM2-135M-Instruct
Parameters
135M
Context
8K
Q4_K_M file
0.10 GB
Q4_K_Mreconstructed size1.8M downloads / 30dCalculator →
HuggingFaceTBllama
SmolLM2-135M
Parameters
135M
Context
8K
Q4_K_M file
0.10 GB
Q4_K_Mreconstructed size1.8M downloads / 30dCalculator →
zai-orgglm4_moe_liteMoE, 64 experts
GLM-4.7-Flash
Parameters
31B
Context
198K
Q4_K_M file
12.3 GB–26.6 GB
Q4_K_Msize range1.8M downloads / 30dCalculator →
Mistral AImistral
Mistral-7B-Instruct-v0.2
Parameters
7.2B
Context
32K
Q4_K_M file
4.37 GB
Q4_K_Mreconstructed size1.7M downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-Coder-14B-Instruct
Parameters
15B
Context
32K
Q4_K_M file
8.99 GB
Q4_K_Mreconstructed size1.7M downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-14B-Instruct
Parameters
15B
Context
32K
Q4_K_M file
8.99 GB
Q4_K_Mreconstructed size1.6M downloads / 30dCalculator →
Qwenqwen3_5_moe_textMoE, 256 experts
Qwen3.5-35B-A3B
Parameters
36B
Context
256K
Q4_K_M file
14.2 GB–31.0 GB
Q4_K_Msize range1.6M downloads / 30dCalculator →
Qwenqwen3_moeMoE, 128 experts
Qwen3-30B-A3B
Parameters
31B
Context
40K
Q4_K_M file
18.6 GB
Q4_K_Mpublished data1.5M downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-0.5B
Parameters
494M
Context
32K
Q4_K_M file
0.41 GB
Q4_K_Mreconstructed size1.5M downloads / 30dCalculator →
ornith-aiqwen3_5_moe_textMoE, 256 experts
Ornith-1.0-35B
Parameters
unknown
Context
256K
Q4_K_M file
21.2 GB
Q4_K_Mpublished data1.5M downloads / 30dCalculator →
The published parameter count contradicts the published file sizes, so it is not used.
EleutherAIgpt_neox
pythia-70m-deduped
Parameters
95.6M
Context
2K
Q4_K_M file
0.04 GB–0.14 GB
Q4_K_Msize range1.4M downloads / 30dCalculator →
DeepSeekdeepseek_v3MoE, 256 experts
DeepSeek-V3-0324
Parameters
685B
Context
160K
Q4_K_M file
269.5 GB–569.4 GB
Q4_K_Msize range1.4M downloads / 30dCalculator →
Qwenqwen4_exp_textMoE, 512 experts
Qwen3.8-Flash-Next
Parameters
180B
Context
256K
Q4_K_M file
70.9 GB–150.6 GB
Q4_K_Msize range1.4M downloads / 30dCalculator →
zai-orgglm_moe_dsaMoE, 256 experts
GLM-5.3
Parameters
753B
Context
1M
Q4_K_M file
446.4 GB
Q4_K_Mreconstructed size1.4M downloads / 30dCalculator →
TinyLlamallama
TinyLlama-1.1B-Chat-v1.0
Parameters
1.1B
Context
2K
Q4_K_M file
0.67 GB
Q4_K_Mreconstructed size1.4M downloads / 30dCalculator →
DeepSeekdeepseek_v3MoE, 256 experts
DeepSeek-V3
Parameters
685B
Context
160K
Q4_K_M file
269.5 GB–569.4 GB
Q4_K_Msize range1.3M downloads / 30dCalculator →
moonshotaikimi_linearMoE, 896 experts
Kimi-K3
Parameters
2.8T total · 104B active parameters
Context
1M
Q4_K_M file
1102.5 GB–2322.7 GB
Q4_K_Msize range1.2M downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
NVIDIAnemotron_hMoE, 512 experts
NVIDIA-Nemotron-3-Super-120B-A12B-BF16
Parameters
124B
Context
256K
Q4_K_M file
48.7 GB–103.7 GB
Q4_K_Msize range1.2M downloads / 30dCalculator →
MiniMaxAIminimax_m2MoE, 256 experts
MiniMax-M2.7
Parameters
229B
Context
200K
Q4_K_M file
138.3 GB
Q4_K_Mreconstructed size1.1M downloads / 30dCalculator →
DeepSeekdeepseek_v4MoE, 256 experts
DeepSeek-V4-Flash
Parameters
284B total · 13B active parameters
Context
1M
Q4_K_M file
175.0 GB
Q4_K_Mreconstructed size1.1M downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
openbmbllama
MiniCPM5-2B
Parameters
2.5B
Context
128K
Q4_K_M file
1.56 GB
Q4_K_Mreconstructed size1.1M downloads / 30dCalculator →
DeepSeekdeepseek_v3MoE, 256 experts
DeepSeek-R1
Parameters
684B
Context
160K
Q4_K_M file
269.5 GB–569.3 GB
Q4_K_Msize range994.2K downloads / 30dCalculator →
DeepSeekqwen2
DeepSeek-R1-Distill-Qwen-1.5B
Parameters
1.8B
Context
128K
Q4_K_M file
1.12 GB
Q4_K_Mreconstructed size961.3K downloads / 30dCalculator →
ornith-aiqwen3_5_text
Ornith-1.0-9B
Parameters
unknown
Context
256K
Q4_K_M file
5.63 GB
Q4_K_Mpublished data949.3K downloads / 30dCalculator →
The published parameter count contradicts the published file sizes, so it is not used.
DeepSeekdeepseek_v4MoE, 256 experts
DeepSeek-V4-Flash-Vision-Exp
Parameters
305B checkpoint · multimodal DSpark
Context
1M
Q4_K_M file
120.1 GB–254.0 GB
Q4_K_Msize range915.3K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
DeepSeekdeepseek_v2MoE, 64 experts
DeepSeek-Coder-V2-Lite-Instruct
Parameters
16B
Context
160K
Q4_K_M file
6.18 GB–13.5 GB
Q4_K_Msize range913.9K downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-Coder-32B-Instruct
Parameters
33B
Context
32K
Q4_K_M file
19.9 GB
Q4_K_Mpublished data890.3K downloads / 30dCalculator →
NVIDIAnemotron_hMoE, 128 experts
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16
Parameters
32B
Context
256K
Q4_K_M file
12.4 GB–27.0 GB
Q4_K_Msize range875.2K downloads / 30dCalculator →
Qwenqwen3_moeMoE, 128 experts
Qwen3-30B-A3B-Instruct-2507
Parameters
31B
Context
256K
Q4_K_M file
18.6 GB
Q4_K_Mreconstructed size866.4K downloads / 30dCalculator →
Qwenqwen2_5_vl
Qwen2.5-VL-32B-Instruct
Parameters
33B
Context
125K
Q4_K_M file
13.2 GB–29.6 GB
Q4_K_Msize range798K downloads / 30dCalculator →
DeepSeekdeepseek_v41_textMoE, 384 experts
DeepSeek-V4.1-Flash
Parameters
552B backbone parameters · 196B Engram
Context
1M
Q4_K_M file
448.6 GB
Q4_K_Mreconstructed size787.8K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
thinkingmachinesinkling_mm_modelMoE, 256 experts
Inkling
Parameters
952B
Context
unknown
Q4_K_M file
585.6 GB
Q4_K_Mreconstructed size778.6K downloads / 30dCalculator →
zai-orgglm_moe_dsaMoE, 256 experts
GLM-5.2
Parameters
753B
Context
1M
Q4_K_M file
446.4 GB
Q4_K_Mreconstructed size705.8K downloads / 30dCalculator →
Qwenqwen3
Qwen3-1.7B-Base
Parameters
1.7B
Context
32K
Q4_K_M file
1.28 GB
Q4_K_Mreconstructed size696K downloads / 30dCalculator →
DeepSeekqwen3
DeepSeek-R1-0528-Qwen3-8B
Parameters
8.2B
Context
128K
Q4_K_M file
5.03 GB
Q4_K_Mreconstructed size694.9K downloads / 30dCalculator →
DeepSeekllama
deepseek-coder-7b-instruct-v1.5
Parameters
6.9B
Context
4K
Q4_K_M file
4.22 GB
Q4_K_Mreconstructed size664.2K downloads / 30dCalculator →
thinkingmachinesinkling_mm_modelMoE, 256 experts
Inkling-Small
Parameters
266B
Context
unknown
Q4_K_M file
104.7 GB–222.3 GB
Q4_K_Msize range657.4K downloads / 30dCalculator →
farbodtavakkoligemma4_text
OTel-LLM-E4B-IT
Parameters
unknown
Context
128K
Weight file
no size
Sizeno data648.7K downloads / 30d
Qwenqwen3
Qwen3-4B-Base
Parameters
4.0B
Context
32K
Q4_K_M file
2.72 GB
Q4_K_Mreconstructed size624.7K downloads / 30dCalculator →
HuggingFaceTBsmollm3
SmolLM3-3B
Parameters
3.1B
Context
64K
Q4_K_M file
2.06 GB
Q4_K_Mreconstructed size617K downloads / 30dCalculator →
Microsoftphi
phi-2
Parameters
2.8B
Context
2K
Q4_K_M file
1.09 GB–2.62 GB
Q4_K_Msize range599.2K downloads / 30dCalculator →
Qwenqwen3_nextMoE, 512 experts
Qwen3-Coder-Next
Parameters
80B
Context
256K
Q4_K_M file
48.4 GB
Q4_K_Mpublished data596.3K downloads / 30dCalculator →
EleutherAIgpt_neox
pythia-14m
Parameters
14.1M
Context
2K
Q4_K_M file
5.5 MB–0.03 GB
Q4_K_Msize range579.5K downloads / 30dCalculator →
IBMgranitemoeMoE, 40 experts
PowerMoE-3b
Parameters
3.4B
Context
4K
Q4_K_M file
2.06 GB
Q4_K_Mreconstructed size552.6K downloads / 30dCalculator →
ByteDance-Seedqwen2_5_vl
UI-TARS-1.5-7B
Parameters
8.3B
Context
125K
Q4_K_M file
3.27 GB–8.16 GB
Q4_K_Msize range550.8K downloads / 30dCalculator →
Mistral AImistral
Mistral-Small-3.1-24B-Instruct-2503
Parameters
24B
Context
128K
Q4_K_M file
14.3 GB
Q4_K_Mreconstructed size543.4K downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-Coder-3B-Instruct
Parameters
3.1B
Context
32K
Q4_K_M file
2.10 GB
Q4_K_Mreconstructed size532.9K downloads / 30dCalculator →
NVIDIAnemotron_hMoE, 128 experts
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16
Parameters
32B
Context
256K
Q4_K_M file
12.4 GB–27.0 GB
Q4_K_Msize range530K downloads / 30dCalculator →
IBMgranite
granite-4.1-3b
Parameters
3.4B
Context
128K
Q4_K_M file
2.24 GB
Q4_K_Mreconstructed size521.8K downloads / 30dCalculator →
rinnagpt_neox
japanese-gpt-neox-small
Parameters
204M
Context
2K
Q4_K_M file
0.08 GB–0.25 GB
Q4_K_Msize range515.7K downloads / 30dCalculator →
Qwenqwen3_5_moe_textMoE, 256 experts
Qwen3.5-122B-A10B
Parameters
125B
Context
256K
Q4_K_M file
49.3 GB–105.5 GB
Q4_K_Msize range512.6K downloads / 30dCalculator →
Qwenqwen3_moeMoE, 128 experts
Qwen3-Coder-30B-A3B-Instruct
Parameters
31B
Context
256K
Q4_K_M file
18.6 GB
Q4_K_Mreconstructed size502.1K downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-Coder-1.5B-Instruct
Parameters
1.5B
Context
32K
Q4_K_M file
1.12 GB
Q4_K_Mreconstructed size497.3K downloads / 30dCalculator →
farbodtavakkoligemma3_text
OTel-LLM-27B-IT
Parameters
unknown
Context
128K
Weight file
no size
Sizeno data491.3K downloads / 30d
Metafile from the unsloth mirrorllama
Llama-3.2-1B-Instruct
Parameters
1.2B
Context
128K
Q4_K_M file
0.95 GB
Q4_K_Mreconstructed size488.5K downloads / 30dCalculator →
allenaiolmo3
Olmo-3-7B-Instruct
Parameters
7.3B
Context
64K
Q4_K_M file
4.47 GB
Q4_K_Mreconstructed size481.7K downloads / 30dCalculator →
moonshotaikimi_k2MoE, 384 experts
Kimi-K2.6
Parameters
1T total · 32B active parameters
Context
256K
Q4_K_M file
393.8 GB–831.3 GB
Q4_K_Msize range472.8K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
Microsoftphi3
phi-4
Parameters
15B
Context
16K
Q4_K_M file
8.89 GB
Q4_K_Mreconstructed size472.3K downloads / 30dCalculator →
EleutherAIgpt_neox
gpt-neox-20b
Parameters
21B
Context
2K
Q4_K_M file
8.17 GB–17.9 GB
Q4_K_Msize range464K downloads / 30dCalculator →
swiss-aiapertus
Apertus-8B-Instruct-2509
Parameters
8.1B
Context
64K
Q4_K_M file
3.17 GB–7.95 GB
Q4_K_Msize range455.8K downloads / 30dCalculator →
ornith-aiqwen3_5_text
Ornith-1.5-9B
Parameters
9.7B
Context
256K
Q4_K_M file
5.78 GB
Q4_K_Mpublished data455.1K downloads / 30dCalculator →
Qwenqwen3_moeMoE, 128 experts
Qwen3-235B-A22B
Parameters
235B
Context
40K
Q4_K_M file
142.2 GB
Q4_K_Mpublished data445.2K downloads / 30dCalculator →
MiniMaxAIminimax_m2MoE, 256 experts
MiniMax-M2.5
Parameters
229B
Context
192K
Q4_K_M file
138.3 GB
Q4_K_Mreconstructed size444.8K downloads / 30dCalculator →
DeepSeekqwen2
DeepSeek-R1-Distill-Qwen-32B
Parameters
33B
Context
128K
Q4_K_M file
19.8 GB
Q4_K_Mreconstructed size440.9K downloads / 30dCalculator →
openbmbllama
MiniCPM5-1B
Parameters
1.1B
Context
128K
Q4_K_M file
0.69 GB
Q4_K_Mpublished data436.8K downloads / 30dCalculator →
Qwenqwen3_vl_moe_textMoE, 128 experts
Qwen3-VL-30B-A3B-Instruct
Parameters
31B
Context
256K
Q4_K_M file
18.6 GB
Q4_K_Mpublished data422.8K downloads / 30dCalculator →
HuggingFaceTBllama
SmolLM2-360M
Parameters
362M
Context
8K
Q4_K_M file
0.26 GB
Q4_K_Mreconstructed size411.5K downloads / 30dCalculator →
Mistral AImistral
Mistral-7B-v0.1
Parameters
7.2B
Context
32K
Q4_K_M file
4.37 GB
Q4_K_Mreconstructed size410.4K downloads / 30dCalculator →
DeepSeekdeepseek_v4MoE, 384 experts
DeepSeek-V4-Pro
Parameters
1.6T total · 49B active parameters
Context
1M
Q4_K_M file
970.3 GB
Q4_K_Mreconstructed size409.5K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
IlyaGusevllama
saiga_llama3_8b
Parameters
8.0B
Context
8K
Q4_K_M file
4.92 GB
Q4_K_Mreconstructed size405.3K downloads / 30dCalculator →
allenaiolmo2
OLMo-2-0425-1B
Parameters
1.5B
Context
4K
Q4_K_M file
0.94 GB
Q4_K_Mpublished data404.2K downloads / 30dCalculator →
NousResearchllama
Hermes-3-Llama-3.1-8B
Parameters
8.0B
Context
128K
Q4_K_M file
4.92 GB
Q4_K_Mpublished data403.4K downloads / 30dCalculator →
codellamallama
CodeLlama-7b-hf
Parameters
6.7B
Context
16K
Q4_K_M file
4.08 GB
Q4_K_Mreconstructed size401K downloads / 30dCalculator →
Qwenqwen3_5_moe_textMoE, 512 experts
Qwen3.5-397B-A17B
Parameters
403B
Context
256K
Q4_K_M file
158.8 GB–336.6 GB
Q4_K_Msize range391.2K downloads / 30dCalculator →
tiiuaefalcon
falcon-7b
Parameters
7.2B
Context
unknown
Q4_K_M file
2.84 GB–6.68 GB
Q4_K_Msize range390K downloads / 30dCalculator →
Microsoftphi3
Phi-3.5-mini-instruct
Parameters
3.8B
Context
128K
Q4_K_M file
2.32 GB
Q4_K_Mreconstructed size382.8K downloads / 30dCalculator →
zai-orgglm4_moeMoE, 128 experts
GLM-4.5-Air
Parameters
110B
Context
128K
Q4_K_M file
43.5 GB–93.0 GB
Q4_K_Msize range380.7K downloads / 30dCalculator →
Microsoftphi3
Phi-4-mini-instruct
Parameters
3.8B
Context
128K
Q4_K_M file
2.79 GB
Q4_K_Mreconstructed size370.4K downloads / 30dCalculator →
zai-orgglm_moe_dsaMoE, 256 experts
GLM-5
Parameters
754B
Context
198K
Q4_K_M file
446.4 GB
Q4_K_Mreconstructed size365.3K downloads / 30dCalculator →
NVIDIAnemotron_hMoE, 512 experts
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16
Parameters
561B
Context
256K
Q4_K_M file
220.7 GB–467.0 GB
Q4_K_Msize range358K downloads / 30dCalculator →
ornith-aiqwen3_5_moe_textMoE, 512 experts
Ornith-1.5-397B
Parameters
403B
Context
256K
Q4_K_M file
244.3 GB
Q4_K_Mpublished data350.6K downloads / 30dCalculator →
DeepSeekdeepseek_v3MoE, 256 experts
DeepSeek-V3.1
Parameters
685B
Context
160K
Q4_K_M file
269.5 GB–569.4 GB
Q4_K_Msize range347.2K downloads / 30dCalculator →
Microsoftphi3
Phi-3-mini-4k-instruct
Parameters
3.8B
Context
4K
Q4_K_M file
2.32 GB
Q4_K_Mreconstructed size346.3K downloads / 30dCalculator →
Mistral AImistral
Mistral-Nemo-Instruct-2407
Parameters
12B
Context
128K
Q4_K_M file
7.47 GB
Q4_K_Mreconstructed size338.9K downloads / 30dCalculator →
DeepSeekqwen2
DeepSeek-R1-Distill-Qwen-14B
Parameters
15B
Context
128K
Q4_K_M file
8.99 GB
Q4_K_Mreconstructed size337.3K downloads / 30dCalculator →
Qwenqwen3_vl_text
Qwen3-VL-32B-Instruct
Parameters
33B
Context
256K
Q4_K_M file
19.8 GB
Q4_K_Mpublished data335.3K downloads / 30dCalculator →
NVIDIAnemotron_h
NVIDIA-Nemotron-Nano-9B-v2
Parameters
8.9B
Context
128K
Q4_K_M file
3.50 GB–8.76 GB
Q4_K_Msize range333.6K downloads / 30dCalculator →
Qwenqwen3_vl_moe_textMoE, 128 experts
Qwen3-VL-235B-A22B-Instruct
Parameters
236B
Context
256K
Q4_K_M file
142.2 GB
Q4_K_Mpublished data327K downloads / 30dCalculator →
moonshotaikimi_k2MoE, 384 experts
Kimi-K2.5
Parameters
1T total · 32B active parameters
Context
256K
Q4_K_M file
393.8 GB–831.3 GB
Q4_K_Msize range320K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
LGAI-EXAONEexaone
EXAONE-3.5-7.8B-Instruct
Parameters
7.8B
Context
32K
Q4_K_M file
4.77 GB
Q4_K_Mpublished data316.1K downloads / 30dCalculator →
moonshotaikimi_k2MoE, 384 experts
Kimi-K2-Instruct
Parameters
1026B
Context
128K
Q4_K_M file
619.0 GB
Q4_K_Mreconstructed size314.7K downloads / 30dCalculator →
webAI-Officialsmollm3
TwIL-LM3
Parameters
3.1B
Context
64K
Q4_K_M file
2.06 GB
Q4_K_Mreconstructed size307.4K downloads / 30dCalculator →
Tencenthy_v3MoE, 192 experts
Hy3
Parameters
299B
Context
256K
Q4_K_M file
177.7 GB
Q4_K_Mreconstructed size304.9K downloads / 30dCalculator →
IBMgranite
granite-4.1-30b
Parameters
29B
Context
128K
Q4_K_M file
17.5 GB
Q4_K_Mpublished data301.5K downloads / 30dCalculator →
MiniMaxAIminimax_m2MoE, 256 experts
MiniMax-M2
Parameters
229B
Context
192K
Q4_K_M file
138.3 GB
Q4_K_Mreconstructed size287.6K downloads / 30dCalculator →
Qwenqwen2
Qwen2.5-72B-Instruct
Parameters
73B
Context
32K
Q4_K_M file
43.8 GB
Q4_K_Mreconstructed size287.5K downloads / 30dCalculator →
Qwenqwen3_nextMoE, 512 experts
Qwen3-Next-80B-A3B-Instruct
Parameters
81B
Context
256K
Q4_K_M file
48.4 GB
Q4_K_Mpublished data285.9K downloads / 30dCalculator →
huggyllamallama
llama-7b
Parameters
6.7B
Context
2K
Q4_K_M file
4.08 GB
Q4_K_Mreconstructed size277.9K downloads / 30dCalculator →
meta-modelsmuse_glimmer_text
Muse-Glimmer-30B
Parameters
30B
Context
128K
Q4_K_M file
11.7 GB–27.9 GB
Q4_K_Msize range276.2K downloads / 30dCalculator →
InternScienceqwen3_5_text
Agents-A1-4B
Parameters
4.5B
Context
256K
Q4_K_M file
1.79 GB–5.27 GB
Q4_K_Msize range275.5K downloads / 30dCalculator →
HuggingFaceTBllama
SmolLM2-360M-Instruct
Parameters
362M
Context
8K
Q4_K_M file
0.26 GB
Q4_K_Mreconstructed size275.3K downloads / 30dCalculator →
ornith-aiqwen3_5_moe_textMoE, 256 experts
Ornith-1.5-35B-A3B
Parameters
36B
Context
256K
Q4_K_M file
21.7 GB
Q4_K_Mpublished data270.8K downloads / 30dCalculator →
zai-orgglm_moe_dsaMoE, 256 experts
GLM-5.1
Parameters
754B
Context
198K
Q4_K_M file
446.4 GB
Q4_K_Mreconstructed size267.1K downloads / 30dCalculator →
DeepSeekqwen2
DeepSeek-R1-Distill-Qwen-7B
Parameters
7.6B
Context
128K
Q4_K_M file
4.68 GB
Q4_K_Mreconstructed size267.1K downloads / 30dCalculator →
ai-sagedeepseek_v3MoE, 64 experts
GigaChat3.1-Audio-10B-A1.8B
Parameters
unknown
Context
256K
Weight file
no size
Sizeno data261.8K downloads / 30d
EleutherAIgpt_neox
pythia-410m
Parameters
506M
Context
2K
Q4_K_M file
0.32 GB
Q4_K_Mreconstructed size261.6K downloads / 30dCalculator →
Mistral AImistral
Mistral-Small-3.2-24B-Instruct-2506
Parameters
24B
Context
128K
Q4_K_M file
14.3 GB
Q4_K_Mreconstructed size256K downloads / 30dCalculator →
Mistral AIministral3
Ministral-3-14B-Instruct-2512
Parameters
14B
Context
256K
Q4_K_M file
8.24 GB
Q4_K_Mpublished data251K downloads / 30dCalculator →
NousResearchllama
Meta-Llama-3.1-8B-Instruct
Parameters
8.0B
Context
128K
Q4_K_M file
4.92 GB
Q4_K_Mreconstructed size247.2K downloads / 30dCalculator →
XiaomiMiMomimo_v2MoE, 256 experts
MiMo-V2.5
Parameters
311B
Context
1M
Q4_K_M file
191.2 GB
Q4_K_Mreconstructed size245.2K downloads / 30dCalculator →
Zyphrazamba2
Zamba2-1.2B-instruct
Parameters
1.2B
Context
4K
Q4_K_M file
0.48 GB–1.16 GB
Q4_K_Msize range227.8K downloads / 30dCalculator →
DeepSeekdeepseek_v2MoE, 64 experts
DeepSeek-V2-Lite
Parameters
16B
Context
160K
Q4_K_M file
6.18 GB–13.5 GB
Q4_K_Msize range223K downloads / 30dCalculator →
inclusionAIllada2_moeMoE, 256 experts
LLaDA2.0-mini
Parameters
16B
Context
32K
Q4_K_M file
9.86 GB
Q4_K_Mreconstructed size217.2K downloads / 30dCalculator →
sarvamaisarvam_moeMoE, 128 experts
sarvam-30b
Parameters
32B
Context
128K
Q4_K_M file
19.5 GB
Q4_K_Mreconstructed size216.5K downloads / 30dCalculator →
Mistral AImixtralMoE, 8 experts
Mixtral-8x7B-Instruct-v0.1
Parameters
47B
Context
32K
Q4_K_M file
28.3 GB
Q4_K_Mreconstructed size214.9K downloads / 30dCalculator →
HuggingFaceTBllama
SmolLM2-1.7B-Instruct
Parameters
1.7B
Context
8K
Q4_K_M file
1.11 GB
Q4_K_Mreconstructed size214K downloads / 30dCalculator →
Metafile from the unsloth mirrorllama
Llama-3.2-3B-Instruct
Parameters
3.2B
Context
128K
Q4_K_M file
2.24 GB
Q4_K_Mreconstructed size205.3K downloads / 30dCalculator →
moonshotaikimi_linearMoE, 256 experts
Kimi-Linear-48B-A3B-Instruct
Parameters
49B
Context
unknown
Q4_K_M file
29.5 GB
Q4_K_Mreconstructed size205K downloads / 30dCalculator →
DeepSeekllama
DeepSeek-R1-Distill-Llama-8B
Parameters
8.0B
Context
128K
Q4_K_M file
4.92 GB
Q4_K_Mreconstructed size198.4K downloads / 30dCalculator →
Qwenqwen3_moeMoE, 128 experts
Qwen3-235B-A22B-Instruct-2507
Parameters
235B
Context
256K
Q4_K_M file
142.2 GB
Q4_K_Mreconstructed size196.2K downloads / 30dCalculator →
stepfun-aistep3p5
Step-3.5-Flash
Parameters
199B
Context
256K
Q4_K_M file
78.5 GB–166.5 GB
Q4_K_Msize range195.2K downloads / 30dCalculator →
NousResearchllama
Llama-2-7b-hf
Parameters
6.7B
Context
4K
Q4_K_M file
4.08 GB
Q4_K_Mreconstructed size194.5K downloads / 30dCalculator →
DeepSeekllama
deepseek-coder-6.7b-instruct
Parameters
6.7B
Context
16K
Q4_K_M file
4.08 GB
Q4_K_Mreconstructed size187.1K downloads / 30dCalculator →
ornith-aiqwen3_5_moe_textMoE, 512 experts
Ornith-1.0-397B
Parameters
397B
Context
256K
Q4_K_M file
238.8 GB
Q4_K_Mreconstructed size185.1K downloads / 30dCalculator →
poolsidelagunaMoE, 256 experts
Laguna-XS-2.1
Parameters
33B
Context
256K
Q4_K_M file
20.3 GB
Q4_K_Mpublished data183K downloads / 30dCalculator →
TIGER-Labphi3_v
VLM2Vec-Full
Parameters
4.1B
Context
128K
Q4_K_M file
1.63 GB–3.67 GB
Q4_K_Msize range182.5K downloads / 30dCalculator →
CohereLabscohere_compass_text
North-Micro-Vision-Instruct
Parameters
2.5B
Context
488K
Q4_K_M file
1.60 GB
Q4_K_Mreconstructed size180.7K downloads / 30dCalculator →
IBMgranite
granite-4.1-8b
Parameters
8.8B
Context
128K
Q4_K_M file
5.35 GB
Q4_K_Mpublished data179.3K downloads / 30dCalculator →
MiniMaxAIminimax_m3_vlMoE, 128 experts
MiniMax-M3
Parameters
427B
Context
1M
Q4_K_M file
168.1 GB–356.7 GB
Q4_K_Msize range177.2K downloads / 30dCalculator →
DeepSeekdeepseek_v3MoE, 256 experts
DeepSeek-R1-0528
Parameters
685B
Context
160K
Q4_K_M file
269.5 GB–569.4 GB
Q4_K_Msize range163.8K downloads / 30dCalculator →
poolsidelagunaMoE, 256 experts
Laguna-S-2.1
Parameters
118B
Context
1M
Q4_K_M file
96.0 GB
Q4_K_Mpublished data157.8K downloads / 30dCalculator →
Microsoftphi3
Phi-3-mini-128k-instruct
Parameters
3.8B
Context
128K
Q4_K_M file
2.32 GB
Q4_K_Mreconstructed size150.4K downloads / 30dCalculator →
allenaiolmoeMoE, 64 experts
OLMoE-1B-7B-0125-Instruct
Parameters
6.9B
Context
4K
Q4_K_M file
4.21 GB
Q4_K_Mpublished data145.6K downloads / 30dCalculator →
Qwenqwen3_vl_text
Qwen3-VL-8B-Thinking
Parameters
8.8B
Context
256K
Q4_K_M file
5.03 GB
Q4_K_Mpublished data144.2K downloads / 30dCalculator →
DeepSeekdeepseek_v2MoE, 64 experts
DeepSeek-V2-Lite-Chat
Parameters
16B
Context
160K
Q4_K_M file
6.18 GB–13.5 GB
Q4_K_Msize range143.9K downloads / 30dCalculator →
EleutherAIgpt_neox
pythia-160m-deduped
Parameters
213M
Context
2K
Q4_K_M file
0.08 GB–0.27 GB
Q4_K_Msize range138.7K downloads / 30dCalculator →
HuggingFaceTBsmollm3
SmolLM3-3B-Base
Parameters
3.1B
Context
64K
Q4_K_M file
2.06 GB
Q4_K_Mreconstructed size133.5K downloads / 30dCalculator →
IBMgranite
granite-4.2-8b
Parameters
8.8B
Context
128K
Q4_K_M file
5.35 GB
Q4_K_Mpublished data128.4K downloads / 30dCalculator →
SupraLabsqwen3
Supra2-100M-Instruct
Parameters
101M
Context
2K
Q4_K_M file
0.08 GB
Q4_K_Mreconstructed size122.5K downloads / 30dCalculator →
Mistral AIministral3
Ministral-3-8B-Instruct-2512
Parameters
8.9B
Context
256K
Q4_K_M file
5.20 GB
Q4_K_Mpublished data121.2K downloads / 30dCalculator →
LiquidAIlfm2
LFM2.5-1.2B-Instruct
Parameters
1.2B
Context
125K
Q4_K_M file
0.73 GB
Q4_K_Mpublished data119.2K downloads / 30dCalculator →
zai-orgglm4_moeMoE, 160 experts
GLM-4.5
Parameters
358B
Context
128K
Q4_K_M file
141.1 GB–298.7 GB
Q4_K_Msize range117.7K downloads / 30dCalculator →
Mistral AIministral3
Ministral-3-3B-Instruct-2512
Parameters
3.8B
Context
256K
Q4_K_M file
2.15 GB
Q4_K_Mpublished data114.1K downloads / 30dCalculator →
moonshotaikimi_k2MoE, 384 experts
Kimi-K2.7-Code
Parameters
1T total · 32B active parameters
Context
256K
Q4_K_M file
393.8 GB–831.3 GB
Q4_K_Msize range110.7K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
TitanMLmixtralMoE, 8 experts
tiny-mixtral
Parameters
247M
Context
128K
Q4_K_M file
0.16 GB
Q4_K_Mreconstructed size110.7K downloads / 30dCalculator →
LiquidAIlfm2
LFM2.5-2.6B
Parameters
2.7B
Context
128K
Q4_K_M file
1.67 GB
Q4_K_Mpublished data108.1K downloads / 30dCalculator →
Tencenthy_v3MoE, 192 experts
Hy3-preview
Parameters
299B
Context
256K
Q4_K_M file
177.7 GB
Q4_K_Mreconstructed size104.7K downloads / 30dCalculator →
zai-orgglm4v_text
GLM-4.6V-Flash
Parameters
10B
Context
128K
Q4_K_M file
4.05 GB–10.0 GB
Q4_K_Msize range103.7K downloads / 30dCalculator →
XiaomiMiMomimo_v2_flashMoE, 256 experts
MiMo-V2-Flash
Parameters
310B
Context
256K
Q4_K_M file
191.2 GB
Q4_K_Mreconstructed size103.6K downloads / 30dCalculator →
zai-orgglm4_moeMoE, 160 experts
GLM-4.7
Parameters
358B
Context
198K
Q4_K_M file
141.1 GB–298.7 GB
Q4_K_Msize range101.6K downloads / 30dCalculator →
Googlefile from the unsloth mirrorgemma3_text
gemma-3-4b-it
Parameters
4.3B
Context
128K
Q4_K_M file
1.69 GB–5.16 GB
Q4_K_Msize range98.8K downloads / 30dCalculator →
DeepSeekdeepseek_v4MoE, 384 experts
DeepSeek-V4-Pro-0813
Parameters
1.6T-class backbone · DSpark attached
Context
1M
Q4_K_M file
970.3 GB
Q4_K_Mreconstructed size95.5K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
LiquidAIlfm2
LFM2.5-230M
Parameters
230M
Context
125K
Q4_K_M file
0.15 GB
Q4_K_Mpublished data88.6K downloads / 30dCalculator →
XiaomiMiMomimo_v2MoE, 384 experts
MiMo-V2.6-Pro-RL
Parameters
1.02T total · 42B active parameters
Context
1M
Q4_K_M file
627.8 GB
Q4_K_Mreconstructed size84.8K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
Qwenqwen3_moeMoE, 128 experts
Qwen3-30B-A3B-Thinking-2507
Parameters
31B
Context
256K
Q4_K_M file
18.6 GB
Q4_K_Mreconstructed size84.4K downloads / 30dCalculator →
Edge0qwen3_5_moe_textMoE, 256 experts
Edge0-35B-A3B-preview
Parameters
35B-class sparse MoE · 256 experts · 4 active
Context
256K
Q4_K_M file
13.8 GB–30.2 GB
Q4_K_Msize range80.6K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
Nanbeigenanbeige
Nanbeige4.2-3B
Parameters
4.2B
Context
256K
Q4_K_M file
2.58 GB
Q4_K_Mreconstructed size78.5K downloads / 30dCalculator →
Qwenqwen2_5_vl
Qwen2.5-VL-72B-Instruct
Parameters
73B
Context
125K
Q4_K_M file
43.8 GB
Q4_K_Mreconstructed size74.3K downloads / 30dCalculator →
MicrosoftphimoeMoE, 16 experts
Phi-tiny-MoE-instruct
Parameters
3.8B
Context
4K
Q4_K_M file
2.29 GB
Q4_K_Mreconstructed size71.7K downloads / 30dCalculator →
LiquidAIlfm2
LFM2.5-350M
Parameters
354M
Context
125K
Q4_K_M file
0.23 GB
Q4_K_Mpublished data69.9K downloads / 30dCalculator →
DeepSeekllama
DeepSeek-R1-Distill-Llama-70B
Parameters
71B
Context
128K
Q4_K_M file
42.5 GB
Q4_K_Mreconstructed size69.8K downloads / 30dCalculator →
Tencenthunyuan_v1_moeMoE, 64 experts
Hunyuan-A13B-Instruct
Parameters
80B
Context
32K
Q4_K_M file
48.8 GB
Q4_K_Mpublished data68.4K downloads / 30dCalculator →
moonshotaikimi_k2MoE, 384 experts
Kimi-K2-Instruct-0905
Parameters
1026B
Context
256K
Q4_K_M file
619.0 GB
Q4_K_Mreconstructed size67.2K downloads / 30dCalculator →
HuggingFaceTBllama
SmolLM2-1.7B
Parameters
1.7B
Context
8K
Q4_K_M file
1.11 GB
Q4_K_Mreconstructed size66K downloads / 30dCalculator →
moonshotaikimi_k2MoE, 384 experts
Kimi-K2-Thinking
Parameters
1T total · 32B active parameters
Context
256K
Q4_K_M file
393.8 GB–831.3 GB
Q4_K_Msize range63.5K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
Googlefile from the unsloth mirrorgemma3_text
gemma-3-1b-it
Parameters
1000M
Context
32K
Q4_K_M file
0.85 GB
Q4_K_Mreconstructed size59.8K downloads / 30dCalculator →
allenaiolmo2
OLMo-2-0325-32B-Instruct
Parameters
32B
Context
4K
Q4_K_M file
19.5 GB
Q4_K_Mreconstructed size59.3K downloads / 30dCalculator →
Mistral AImistral
Mistral-Small-24B-Instruct-2501
Parameters
24B
Context
32K
Q4_K_M file
14.3 GB
Q4_K_Mreconstructed size57.5K downloads / 30dCalculator →
Mistral AImistral4MoE, 128 experts
Mistral-Small-4-119B-2603
Parameters
119B
Context
256K
Q4_K_M file
71.6 GB
Q4_K_Mreconstructed size54.3K downloads / 30dCalculator →
DeepSeekdeepseek_v32MoE, 256 experts
DeepSeek-V3.2-Exp
Parameters
685B
Context
160K
Q4_K_M file
269.9 GB–570.1 GB
Q4_K_Msize range53.4K downloads / 30dCalculator →
IBMgranite
granite-4.2-3b
Parameters
3.7B
Context
128K
Q4_K_M file
2.24 GB
Q4_K_Mpublished data50.6K downloads / 30dCalculator →
XingChen-AGIxing4_0MoE, 64 experts
Xing4.0-29B-A4B
Parameters
31B
Context
256K
Q4_K_M file
12.3 GB–27.0 GB
Q4_K_Msize range50K downloads / 30dCalculator →
XiaomiMiMomimo_v2MoE, 256 experts
MiMo-V2.6-Flash-RL
Parameters
309B total · 15B active parameters
Context
1M
Q4_K_M file
191.2 GB
Q4_K_Mreconstructed size48.6K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
Metafile from the unsloth mirrorllama
Llama-3.3-70B-Instruct
Parameters
71B
Context
128K
Q4_K_M file
42.5 GB
Q4_K_Mreconstructed size48.6K downloads / 30dCalculator →
Qwenqwen3_nextMoE, 512 experts
Qwen3-Next-80B-A3B-Thinking
Parameters
81B
Context
256K
Q4_K_M file
48.4 GB
Q4_K_Mpublished data41.5K downloads / 30dCalculator →
zai-orgglm4v_moe_textMoE, 128 experts
GLM-4.5V
Parameters
108B
Context
64K
Q4_K_M file
63.9 GB
Q4_K_Mreconstructed size39.9K downloads / 30dCalculator →
Googlefile from the unsloth mirrorgemma3_text
gemma-3-27b-it
Parameters
27B
Context
128K
Q4_K_M file
17.3 GB
Q4_K_Mreconstructed size39.7K downloads / 30dCalculator →
Mistral AImixtralMoE, 8 experts
Mixtral-8x22B-Instruct-v0.1
Parameters
141B
Context
64K
Q4_K_M file
85.0 GB
Q4_K_Mreconstructed size39.6K downloads / 30dCalculator →
IFMk2_horizon0
K2-Horizon-0.9B
Parameters
1.1B
Context
128K
Q4_K_M file
0.67 GB
Q4_K_Mreconstructed size39K downloads / 30dCalculator →
XHTokenspark2_5
Spark-X2.5-4B
Parameters
4.1B
Context
1M
Q4_K_M file
2.73 GB
Q4_K_Mreconstructed size38.9K downloads / 30dCalculator →
jica98qwen3_5_text
qwen3.5-4B-super-coder
Parameters
unknown
Context
256K
Weight file
no size
Sizeno data37K downloads / 30d
OpenAIgpt_ossMoE, 32 experts
gpt-oss-safeguard-20b
Parameters
21B total · 3.6B active parameters
Context
128K
Q4_K_M file
12.8 GB
Q4_K_Mreconstructed size36.3K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
Qwenqwen3_moeMoE, 160 experts
Qwen3-Coder-480B-A35B-Instruct
Parameters
480B
Context
256K
Q4_K_M file
290.1 GB
Q4_K_Mreconstructed size36.1K downloads / 30dCalculator →
IBMgranite
granite-4.2-30b
Parameters
29B
Context
128K
Q4_K_M file
17.7 GB
Q4_K_Mpublished data35.8K downloads / 30dCalculator →
Qwenqwen3_5_moe_textMoE, 512 experts
Qwen3.8-2.4T-A95B
Parameters
2446B
Context
256K
Q4_K_M file
1457.5 GB
Q4_K_Mreconstructed size35.7K downloads / 30dCalculator →
Googlefile from the unsloth mirrorgemma2
gemma-2-2b-it
Parameters
2.6B
Context
8K
Q4_K_M file
2.04 GB
Q4_K_Mreconstructed size34.5K downloads / 30dCalculator →
nex-agiqwen3_5_moe_textMoE, 512 experts
Nex-N2.5-Pro
Parameters
397B
Context
256K
Q4_K_M file
238.8 GB
Q4_K_Mreconstructed size32.9K downloads / 30dCalculator →
LiquidAIlfm2_moeMoE, 32 experts
LFM2.5-8B-A1B
Parameters
8.5B
Context
125K
Q4_K_M file
5.16 GB
Q4_K_Mpublished data32.4K downloads / 30dCalculator →
Youssofalqwen3_5_text
Qwen3.8-27B-MTPLX-Optimized-Speed
Parameters
27B-class · 4-bit dynamic quantization
Context
256K
Q4_K_M file
10.6 GB–25.4 GB
Q4_K_Msize range31K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
TokenRhythmqwen3_5_text
NeoHorse-1-4B
Parameters
4.2B
Context
256K
Q4_K_M file
1.66 GB–5.00 GB
Q4_K_Msize range29.1K downloads / 30dCalculator →
Tencenthunyuan_v1_dense
Hy-MT2-1.8B
Parameters
2.0B
Context
256K
Q4_K_M file
1.13 GB
Q4_K_Mpublished data28.9K downloads / 30dCalculator →
IFMk2_horizon0
K2-Horizon-7B
Parameters
9.0B
Context
512K
Q4_K_M file
5.59 GB
Q4_K_Mreconstructed size28K downloads / 30dCalculator →
LGAI-EXAONEexaone4
EXAONE-4.0-32B
Parameters
32B
Context
128K
Q4_K_M file
19.3 GB
Q4_K_Mreconstructed size27.2K downloads / 30dCalculator →
LiquidAIlfm2
LFM2.5-VL-3B
Parameters
3.1B
Context
32K
Q4_K_M file
1.23 GB–3.21 GB
Q4_K_Msize range26.7K downloads / 30dCalculator →
Tencenthy_v4MoE, 256 experts
Hy4-preview
Parameters
780B
Context
1M
Q4_K_M file
464.5 GB
Q4_K_Mreconstructed size25.9K downloads / 30dCalculator →
stepfun-aistep3p5
Step-3.7-Flash
Parameters
201B
Context
256K
Q4_K_M file
79.3 GB–168.1 GB
Q4_K_Msize range24.8K downloads / 30dCalculator →
Mistral AIllama
Voxtral-Small-24B-2507
Parameters
24B
Context
32K
Q4_K_M file
9.55 GB–21.7 GB
Q4_K_Msize range24.5K downloads / 30dCalculator →
sarvamaisarvam_mlaMoE, 128 experts
sarvam-105b
Parameters
106B
Context
128K
Q4_K_M file
63.8 GB
Q4_K_Mreconstructed size24.2K downloads / 30dCalculator →
LGAI-EXAONEexaone4
EXAONE-4.0-1.2B
Parameters
1.3B
Context
64K
Q4_K_M file
0.93 GB
Q4_K_Mreconstructed size24K downloads / 30dCalculator →
DeepSeekdeepseek_v3MoE, 256 experts
DeepSeek-V3.1-Terminus
Parameters
685B
Context
160K
Q4_K_M file
269.5 GB–569.4 GB
Q4_K_Msize range23.8K downloads / 30dCalculator →
Mistral AImistral
Devstral-Small-2507
Parameters
24B
Context
128K
Q4_K_M file
14.3 GB
Q4_K_Mpublished data22.7K downloads / 30dCalculator →
XiaomiMiMomimo_v2MoE, 384 experts
MiMo-V2.5-Pro
Parameters
1023B
Context
1M
Q4_K_M file
627.8 GB
Q4_K_Mreconstructed size22.1K downloads / 30dCalculator →
swiss-aiapertus
Apertus-70B-Instruct-2509
Parameters
71B
Context
64K
Q4_K_M file
27.8 GB–61.0 GB
Q4_K_Msize range21.8K downloads / 30dCalculator →
IFMk2_horizon0
K2-Horizon-3.7B
Parameters
5.1B
Context
512K
Q4_K_M file
3.16 GB
Q4_K_Mreconstructed size20.1K downloads / 30dCalculator →
sapientinchrm_text
HRM-Text-1B
Parameters
1.2B
Context
4K
Q4_K_M file
0.47 GB–1.22 GB
Q4_K_Msize range19.7K downloads / 30dCalculator →
Baiduernie4_5_moe
ERNIE-4.5-21B-A3B-PT
Parameters
22B
Context
128K
Q4_K_M file
8.64 GB–18.8 GB
Q4_K_Msize range19.2K downloads / 30dCalculator →
Qwenqwen3_moeMoE, 128 experts
Qwen3-235B-A22B-Thinking-2507
Parameters
235B
Context
256K
Q4_K_M file
142.2 GB
Q4_K_Mreconstructed size18.2K downloads / 30dCalculator →
inclusionAIbailing_hybridMoE, 128 experts
Ling-3.0-tiny
Parameters
7.9B
Context
128K
Q4_K_M file
4.82 GB
Q4_K_Mpublished data17.7K downloads / 30dCalculator →
Qwenqwen3_vl_moe_textMoE, 128 experts
Qwen3-VL-30B-A3B-Thinking
Parameters
31B
Context
256K
Q4_K_M file
18.6 GB
Q4_K_Mpublished data17.7K downloads / 30dCalculator →
zai-orgglm4_moeMoE, 160 experts
GLM-4.6
Parameters
357B
Context
198K
Q4_K_M file
211.8 GB
Q4_K_Mreconstructed size17.5K downloads / 30dCalculator →
Googlefile from the unsloth mirrorgemma3_text
gemma-3-12b-it
Parameters
12B
Context
128K
Q4_K_M file
4.80 GB–12.5 GB
Q4_K_Msize range17.1K downloads / 30dCalculator →
Cactus-Computeneedle
needle2
Parameters
unknown
Context
2K
Weight file
no size
Sizeno data16.8K downloads / 30d
IFMk2_horizonMoE, 192 experts
K2-Horizon-375B-A23B
Parameters
379B
Context
512K
Q4_K_M file
227.7 GB
Q4_K_Mreconstructed size16.5K downloads / 30dCalculator →
inclusionAIbailing_hybridMoE, 512 experts
Ling-3.0-flash
Parameters
127B
Context
256K
Q4_K_M file
77.0 GB
Q4_K_Mpublished data15.5K downloads / 30dCalculator →
Tencenthunyuan_v1_dense
Hy-MT2-7B
Parameters
8.0B
Context
256K
Q4_K_M file
4.62 GB
Q4_K_Mpublished data15.4K downloads / 30dCalculator →
TokenRhythmqwen3_5_text
NeoHorse-1-9B
Parameters
9.0B
Context
256K
Q4_K_M file
3.53 GB–9.83 GB
Q4_K_Msize range14.7K downloads / 30dCalculator →
XiaomiMiMoqwen3_5_text
MiMo-V2.6-Distill-Qwen-9B
Parameters
9.4B
Context
256K
Q4_K_M file
3.71 GB–10.2 GB
Q4_K_Msize range14.6K downloads / 30dCalculator →
NVIDIAgemma3_text
Nemotron-3.5-Content-Safety
Parameters
4.3B
Context
128K
Q4_K_M file
1.69 GB–5.16 GB
Q4_K_Msize range14.1K downloads / 30dCalculator →
MiniMaxAIminimax_m2MoE, 256 experts
MiniMax-M2.1
Parameters
229B
Context
192K
Q4_K_M file
138.3 GB
Q4_K_Mreconstructed size13.8K downloads / 30dCalculator →
QCRIgemma2
Fanar-1-9B-Instruct
Parameters
8.8B
Context
4K
Q4_K_M file
5.64 GB
Q4_K_Mreconstructed size12K downloads / 30dCalculator →
Googlefile from the unsloth mirrorgemma2
gemma-2-9b-it
Parameters
9.2B
Context
8K
Q4_K_M file
6.28 GB
Q4_K_Mreconstructed size10.7K downloads / 30dCalculator →
empero-aiqwen3_5_text
Qwen3.8-9B-Distill
Parameters
9.7B
Context
256K
Q4_K_M file
5.78 GB
Q4_K_Mpublished data10.6K downloads / 30dCalculator →
NVIDIAllama
Llama-3.1-Nemotron-Nano-8B-v1
Parameters
8.0B
Context
128K
Q4_K_M file
4.92 GB
Q4_K_Mreconstructed size10.4K downloads / 30dCalculator →
Tencenthy_v3MoE, 128 experts
Hy-MT2-30B-A3B
Parameters
30B
Context
256K
Q4_K_M file
18.2 GB
Q4_K_Mpublished data10.3K downloads / 30dCalculator →
nex-agiqwen3_5_moe_textMoE, 256 experts
Nex-N2.5-mini
Parameters
35B
Context
256K
Q4_K_M file
13.8 GB–30.3 GB
Q4_K_Msize range10.2K downloads / 30dCalculator →
Kwaipilotqwen3_5_moe_textMoE, 256 experts
KAT-Coder-V2.5-Dev
Parameters
35B
Context
256K
Q4_K_M file
20.8 GB
Q4_K_Mreconstructed size10.1K downloads / 30dCalculator →
Altworldqwen3_5_text
Hemmingway-1
Parameters
27B
Context
256K
Q4_K_M file
10.6 GB–25.3 GB
Q4_K_Msize range9.8K downloads / 30dCalculator →
InternScienceqwen3_5_moe_textMoE, 256 experts
Agents-A1
Parameters
35B
Context
256K
Q4_K_M file
13.8 GB–30.3 GB
Q4_K_Msize range9.7K downloads / 30dCalculator →
empero-aiqwen3_5_text
Qwen3.8-4B-Distill
Parameters
4.7B
Context
256K
Q4_K_M file
2.78 GB
Q4_K_Mpublished data9.7K downloads / 30dCalculator →
CohereLabscohere2_moeMoE, 128 experts
North-Mini-Code-1.0
Parameters
30B
Context
488K
Q4_K_M file
18.9 GB
Q4_K_Mreconstructed size9.4K downloads / 30dCalculator →
Qwenqwen3_5_moe_textMoE, 256 experts
Qwen-AgentWorld-35B-A3B
Parameters
35B
Context
256K
Q4_K_M file
20.8 GB
Q4_K_Mreconstructed size9.2K downloads / 30dCalculator →
XHTokenspark2_5
Spark-X2.5-1.7B
Parameters
1.7B
Context
1M
Q4_K_M file
1.24 GB
Q4_K_Mreconstructed size8.5K downloads / 30dCalculator →
Mistral AIministral3
Devstral-2-123B-Instruct-2512
Parameters
125B
Context
256K
Q4_K_M file
74.9 GB
Q4_K_Mreconstructed size8.2K downloads / 30dCalculator →
dphnmistral
Dolphin-Mistral-24B-Venice-Edition
Parameters
24B
Context
128K
Q4_K_M file
14.3 GB
Q4_K_Mreconstructed size7.7K downloads / 30dCalculator →
NVIDIAnemotron_hMoE, 128 experts
Nemotron-Cascade-2-30B-A3B
Parameters
32B
Context
256K
Q4_K_M file
12.4 GB–27.0 GB
Q4_K_Msize range7.2K downloads / 30dCalculator →
IBMgranitemoehybrid0
granite-4.0-h-micro
Parameters
3.2B
Context
128K
Q4_K_M file
1.94 GB
Q4_K_Mpublished data6.8K downloads / 30dCalculator →
empero-aiqwen3_5_moe_textMoE, 256 experts
Qwen3.8-35B-A3B-Distill
Parameters
35B
Context
256K
Q4_K_M file
13.8 GB–30.3 GB
Q4_K_Msize range6.5K downloads / 30dCalculator →
Nanbeigellama
Nanbeige4.1-3B
Parameters
3.9B
Context
256K
Q4_K_M file
2.45 GB
Q4_K_Mreconstructed size6.1K downloads / 30dCalculator →
Mistral AImistral
Magistral-Small-2509
Parameters
24B
Context
128K
Q4_K_M file
14.3 GB
Q4_K_Mpublished data5.8K downloads / 30dCalculator →
WeiboAIqwen2
VibeThinker-3B
Parameters
3.1B
Context
128K
Q4_K_M file
2.10 GB
Q4_K_Mreconstructed size5.3K downloads / 30dCalculator →
XiaomiMiMomimo_v2MoE, 256 experts
MiMo-V2.6-Flash-MOPD
Parameters
309B total · 15B active parameters
Context
1M
Q4_K_M file
191.2 GB
Q4_K_Mreconstructed size5K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
Metafile from the unsloth mirrorllama
Meta-Llama-3.1-70B-Instruct
Parameters
71B
Context
128K
Q4_K_M file
42.5 GB
Q4_K_Mreconstructed size4.9K downloads / 30dCalculator →
yandexalice_aiMoE, 512 experts
AliceAI-Foundation-80B-A3B-Base
Parameters
81B
Context
256K
Q4_K_M file
32.0 GB–68.0 GB
Q4_K_Msize range4.5K downloads / 30dCalculator →
inclusionAIbailing_hybridMoE, 256 experts
Ring-2.5-1T
Parameters
1012B
Context
128K
Q4_K_M file
601.7 GB
Q4_K_Mreconstructed size4.2K downloads / 30dCalculator →
IBMgranite
granite-guardian-3.3-8b
Parameters
8.2B
Context
128K
Q4_K_M file
4.94 GB
Q4_K_Mpublished data4K downloads / 30dCalculator →
zai-orgglm4v_moe_textMoE, 128 experts
GLM-4.6V
Parameters
108B
Context
128K
Q4_K_M file
63.9 GB
Q4_K_Mreconstructed size3.8K downloads / 30dCalculator →
openbmbminicpm_sala
MiniCPM-SALA
Parameters
9.5B
Context
512K
Q4_K_M file
3.73 GB–8.57 GB
Q4_K_Msize range3.8K downloads / 30dCalculator →
ukisaiqwen3_5_text
Swift-1.5-Qwen3.8-27b
Parameters
28B
Context
256K
Q4_K_M file
10.9 GB–26.0 GB
Q4_K_Msize range3.6K downloads / 30dCalculator →
upstagesolar_open2MoE, 320 experts
Solar-Open2-250B
Parameters
250B
Context
1M
Q4_K_M file
149.7 GB
Q4_K_Mreconstructed size3.6K downloads / 30dCalculator →
zed-industriesllama
zeta-2.1
Parameters
8.3B
Context
32K
Q4_K_M file
5.07 GB
Q4_K_Mreconstructed size3.2K downloads / 30dCalculator →
MiniMaxAIminimax_text_01MoE, 32 experts
MiniMax-Text-01
Parameters
456B
Context
10M
Q4_K_M file
179.6 GB–380.8 GB
Q4_K_Msize range3.1K downloads / 30dCalculator →
TheDrummermistral
Skyfall-36B-v2
Parameters
37B
Context
32K
Q4_K_M file
22.4 GB
Q4_K_Mpublished data3.1K downloads / 30dCalculator →
Baiduernie4_5_moe
ERNIE-4.5-300B-A47B-PT
Parameters
300B
Context
128K
Q4_K_M file
118.3 GB–251.0 GB
Q4_K_Msize range2.8K downloads / 30dCalculator →
NousResearchllama
Hermes-3-Llama-3.1-70B
Parameters
71B
Context
128K
Q4_K_M file
42.5 GB
Q4_K_Mpublished data2.6K downloads / 30dCalculator →
appleqwen3_5_text
LensVLM-9B
Parameters
9.4B
Context
256K
Q4_K_M file
3.71 GB–10.2 GB
Q4_K_Msize range2.3K downloads / 30dCalculator →
TheDrummermistral
UnslopNemo-12B-v4.1
Parameters
12B
Context
1000K
Q4_K_M file
7.48 GB
Q4_K_Mpublished data2K downloads / 30dCalculator →
meituan-longcatMoE, 768 experts
LongCat-2.0
Parameters
1776B
Context
256K
Q4_K_M file
699.1 GB–1474.3 GB
Q4_K_Msize range2K downloads / 30dCalculator →
Metafile from the unsloth mirrorllama4_textMoE, 16 experts
Llama-4-Scout-17B-16E-Instruct
Parameters
109B
Context
10M
Q4_K_M file
42.8 GB–92.5 GB
Q4_K_Msize range1.8K downloads / 30dCalculator →
Mistral AIMoE, 128 experts
Mistral-Large-3-675B-Instruct-2512
Parameters
675B total · 673B language model · 41B active
Context
256K
Q4_K_M file
402.7 GB
Q4_K_Mreconstructed size1.7K downloads / 30dCalculator →
arcee-aiafmoeMoE, 256 experts
Trinity-Large-Thinking
Parameters
399B
Context
256K
Q4_K_M file
241.8 GB
Q4_K_Mpublished data1.7K downloads / 30dCalculator →
XiaomiMiMomimo_v2MoE, 384 experts
MiMo-V2.6-Pro-MOPD
Parameters
1.02T total · 42B active parameters
Context
1M
Q4_K_M file
627.8 GB
Q4_K_Mreconstructed size1.6K downloads / 30dCalculator →
The checkpoint uses packed/fused storage; its storage total is not treated as a logical parameter count.
Sao10Kllama
L3-8B-Lunaris-v1
Parameters
8.0B
Context
8K
Q4_K_M file
4.92 GB
Q4_K_Mreconstructed size1.6K downloads / 30dCalculator →
internlmglm_moe_dsaMoE, 256 experts
Atria-Dawn-Preview
Parameters
753B
Context
1M
Q4_K_M file
446.4 GB
Q4_K_Mreconstructed size1.5K downloads / 30dCalculator →
NousResearchllama
Hermes-4-70B
Parameters
71B
Context
128K
Q4_K_M file
42.5 GB
Q4_K_Mreconstructed size1.4K downloads / 30dCalculator →
Hcompanyqwen3_5_moe_textMoE, 256 experts
Holo4-35B-A3B
Parameters
35B
Context
256K
Q4_K_M file
13.8 GB–30.3 GB
Q4_K_Msize range1.4K downloads / 30dCalculator →
Gryphellama
MythoMax-L2-13b
Parameters
unknown
Context
4K
Weight file
no size
Sizeno data1.4K downloads / 30d
nex-agiqwen3_5_moe_textMoE, 256 experts
Nex-N2-mini
Parameters
35B
Context
256K
Q4_K_M file
13.8 GB–30.3 GB
Q4_K_Msize range1.2K downloads / 30dCalculator →
Googlefile from the unsloth mirrorgemma2
gemma-2-27b-it
Parameters
27B
Context
8K
Q4_K_M file
17.3 GB
Q4_K_Mreconstructed size1.2K downloads / 30dCalculator →
NousResearchllama
Hermes-3-Llama-3.1-405B
Parameters
406B
Context
128K
Q4_K_M file
243.1 GB
Q4_K_Mreconstructed size1.1K downloads / 30dCalculator →
ai-sagegigachat3_5MoE, 256 experts
GigaChat3.5-432B-A28B-Reasoning
Parameters
438B
Context
256K
Q4_K_M file
172.5 GB–365.1 GB
Q4_K_Msize range1.1K downloads / 30dCalculator →
Metafile from the unsloth mirrorllama4_textMoE, 128 experts
Llama-4-Maverick-17B-128E-Instruct
Parameters
402B
Context
1M
Q4_K_M file
158.1 GB–335.2 GB
Q4_K_Msize range1.1K downloads / 30dCalculator →
Sao10Kllama
L3.3-70B-Euryale-v2.3
Parameters
71B
Context
128K
Q4_K_M file
42.5 GB
Q4_K_Mreconstructed size1K downloads / 30dCalculator →
nex-agiqwen3_5_moe_textMoE, 512 experts
Nex-N2-Pro
Parameters
397B
Context
256K
Q4_K_M file
238.8 GB
Q4_K_Mreconstructed size980 downloads / 30dCalculator →
llm-jpllama
llm-jp-4.1-8b-thinking
Parameters
8.6B
Context
64K
Q4_K_M file
5.31 GB
Q4_K_Mreconstructed size921 downloads / 30dCalculator →
NousResearchllama
Hermes-4-405B
Parameters
406B
Context
128K
Q4_K_M file
243.1 GB
Q4_K_Mreconstructed size910 downloads / 30dCalculator →
llm-jpllama
llm-jp-4.1-33b-thinking
Parameters
33B
Context
64K
Q4_K_M file
20.2 GB
Q4_K_Mreconstructed size704 downloads / 30dCalculator →
anthracite-orgqwen2
magnum-v4-72b
Parameters
73B
Context
32K
Q4_K_M file
47.4 GB
Q4_K_Mpublished data700 downloads / 30dCalculator →
llm-jpqwen3_moeMoE, 128 experts
llm-jp-4.1-32b-a3b-thinking
Parameters
32B
Context
64K
Q4_K_M file
19.6 GB
Q4_K_Mreconstructed size697 downloads / 30dCalculator →
RekaAIllama
reka-flash-3
Parameters
21B
Context
32K
Q4_K_M file
12.6 GB
Q4_K_Mreconstructed size674 downloads / 30dCalculator →
RekaAIyasa_model
reka-edge-2603
Parameters
7.1B
Context
16K
Q4_K_M file
2.81 GB–6.88 GB
Q4_K_Msize range591 downloads / 30dCalculator →
Hcompanyqwen3_5_text
Holo4-27B
Parameters
27B
Context
256K
Q4_K_M file
10.8 GB–25.7 GB
Q4_K_Msize range466 downloads / 30dCalculator →
Undi95llama
ReMM-SLERP-L2-13B
Parameters
unknown
Context
4K
Q5_K_M file
9.23 GB
Q5_K_Mpublished data446 downloads / 30dCalculator →
flywheel-aiqwen3_5_moe_textMoE, 256 experts
automotive
Parameters
35B
Context
256K
Q4_K_M file
20.8 GB
Q4_K_Mreconstructed size443 downloads / 30dCalculator →
Sao10Kllama
L3.1-70B-Euryale-v2.2
Parameters
unknown
Context
128K
Weight file
no size
Sizeno data320 downloads / 30d
Aleph-Alphakolibri1MoE, 384 experts
Kolibri-1-BF16
Parameters
78B
Context
256K
Q4_K_M file
47.5 GB
Q4_K_Mreconstructed size0 downloads / 30dCalculator →

Looking for a fine-tune or a GGUF repository? Paste its Hugging Face link →

Looking for a device instead? Browse the hardware directory →