Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OZ
Ozan v1 12B
Ozan · arbazsiddiqui
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
NO
Noromaid 13B v0.3
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
MN 12B Starcannon v1 i1
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GR
Granite-4.1-30B
Granite · unsloth
Params28.9B
Context128K
Q4_K_M17.5 GB
GGUF
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
QW
Qwen3 Esper3 Reasoning CODER Instruct 12B Brainstorm20x
Qwen · mradermacher
Params11.9B
Context40K
Q4_K_M7.2 GB
CodingReasoning
LL
bavest_fin-llama-33b-merged
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
Qwen3 VL 12B Instruct Brainstorm20x
Qwen · mradermacher
Params11.9B
Context256K
Q4_K_M7.2 GB
CodingVision
MI
Pixtral
Mistral · EnlistedGhost
Params12.2B
Context1000K
Q4_K_M7.7 GB
Vision
DE
Ph3della 14B i1
Della · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PY
Pygmalion 3 12B
Pygmalion · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GE
Instinct Python Coder Gemma4 12B Qwen3.8 27B
Gemma · projectj
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
ME
Medra27B
Medra · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
QW
Qwen3 30B A3B Instruct 2507 REAM Heretic
Qwen · mradermacher
Params23.3B
Context256K
Q4_K_M14.2 GB
GGUF
CY
Cydonia 24B v4.3 Heretic v3
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
GR
granite 20b code instruct
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
PA
MS3.2 PaintedFantasy v3 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
Qwen3 Gutenberg Encore 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
NE
Nemostein 3 Hermes Omni 30b A3B
Nemostein · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
GR
MN GRAND Gutenberg Lyra4 Lyra 12B MADNESS i1
Grand · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Small 24B ArliAI RPMax v1.4
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GE
Gemma 4 12B It Heretic
Gemma · SC117
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
GE
Huihui gemma 4 31B it abliterated v2
Gemma · groxaxo
Params30.7B
Context—
Smallest0.0 GB
GGUF
LL
flozi00_llama-2-13b-german-assistant-v4
Llama · TheBloke
Params13.1B
Context2K
Q4_K_M7.9 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
DE
Qwen2.5 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DA
L3.1 Dark Planet 10.7B ExxxxxxxxTended
Dark · DavidAU
Params10.6B
Context128K
Q4_K_M6.5 GB
Roleplay
GE
Gemma 4 26B A4B It ARA Heresy
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 3 12b It Vl Minimax M2.1 Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
NE
Next 12b
Next · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding

Other sizes

Keep browsing