Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
OZ
Ozan v1 12B
Ozan · arbazsiddiqui
Params12.2B
Context128K
Q4_K_M7.5 GB
NO
Noromaid 13B v0.3
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ST
MN 12B Starcannon v1 i1
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GR
Granite-4.1-30B
Granite · unsloth
Params28.9B
Context128K
Q4_K_M17.5 GB
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
QW
Qwen3 Esper3 Reasoning CODER Instruct 12B Brainstorm20x
Qwen · mradermacher
Params11.9B
Context40K
Q4_K_M7.2 GB
LL
bavest_fin-llama-33b-merged
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
QW
Qwen3 VL 12B Instruct Brainstorm20x
Qwen · mradermacher
Params11.9B
Context256K
Q4_K_M7.2 GB
MI
Pixtral
Mistral · EnlistedGhost
Params12.2B
Context1000K
Q4_K_M7.7 GB
DE
Ph3della 14B i1
Della · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
PY
Pygmalion 3 12B
Pygmalion · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Instinct Python Coder Gemma4 12B Qwen3.8 27B
Gemma · projectj
Params11.9B
Context256K
Q4_K_M7.4 GB
ME
Medra27B
Medra · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen3 30B A3B Instruct 2507 REAM Heretic
Qwen · mradermacher
Params23.3B
Context256K
Q4_K_M14.2 GB
CY
Cydonia 24B v4.3 Heretic v3
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GR
granite 20b code instruct
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
PA
MS3.2 PaintedFantasy v3 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3 Gutenberg Encore 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
Nemostein 3 Hermes Omni 30b A3B
Nemostein · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
GR
MN GRAND Gutenberg Lyra4 Lyra 12B MADNESS i1
Grand · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small 24B ArliAI RPMax v1.4
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
Gemma 4 12B It Heretic
Gemma · SC117
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Huihui gemma 4 31B it abliterated v2
Gemma · groxaxo
Params30.7B
Context—
Smallest0.0 GB
LL
flozi00_llama-2-13b-german-assistant-v4
Llama · TheBloke
Params13.1B
Context2K
Q4_K_M7.9 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
DE
Qwen2.5 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DA
L3.1 Dark Planet 10.7B ExxxxxxxxTended
Dark · DavidAU
Params10.6B
Context128K
Q4_K_M6.5 GB
GE
Gemma 4 26B A4B It ARA Heresy
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 12b It Vl Minimax M2.1 Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
NE
Next 12b
Next · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB