Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
wizardlm_wizardcoder-33b-v1.1
Wizardcoder · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
GE
Gemma 4 31B it abliterated
Gemma · LiconStudio
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
AT
Athena v2
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506 Ultra Uncensored Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
LU
dreamgen lucid v1 nemo
Lucid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QU
Quyet 1.0 Large
Quyet · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
QW
Strand-Rust-Coder-14B-v1
Qwen · Mungert
Params14.8B
Context32K
Q4_K_M9.3 GB
Coding
MI
Ministral 3 14B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Reasoning
SE
Sensualize Solar 10.7B
Sensualize · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
LLaMA 30b
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
IR
Iris 12B v1.4.1
Iris · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
IN
Internlm2 Math 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
ES
EstopianMaid 13B
Estopianmaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
QW
Qwen3.8 27B
Qwen · williamliao
Params27.3B
Context256K
Smallest16.1 GB
GGUF
QW
Qwen1.5-MoE-A2.7B-Chat
Qwen · RichardErkhov
Params14.3B
Context32K
Q4_K_M9.5 GB
GGUF
GE
gemma 3 12b it ultra uncensored heretic
Gemma · llmfan46
Params11.8B
Context128K
Smallest4.8 GB
Vision
QW
Qwen3.8-27B
Qwen · jpetrina
Params27.3B
Context256K
Smallest14.5 GB
ReasoningTool use
QW
Qwen3 VL 32B Thinking Heretic v2
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
CodingReasoningVision
QW
Qwen3.6 35B A3B REAM 160 ru agent
Qwen · WaveCut
Params23.1B
Context256K
Q4_K_M14.4 GB
GGUF
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NM DAU
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
DE
DeepCoder 14B Preview
Deepcoder · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Coding
QW
Qwen3.8 27B
Qwen · xs7david
Params27.3B
Context256K
Smallest10.9 GB
Vision
QW
Qwen3.8-27B
Qwen · poisonxa
Params27.3B
Context256K
Smallest13.6 GB
GGUF
QW
Qwen3 32B VL GLM 4.7 Flash HI16 Heretic Uncensored Thinking
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningRoleplayVision
QW
Qwen3 30B A3B Instruct 2507 Pruned REAP 15B A3B
Qwen · 12bitmisfit
Params16B
Context256K
Q4_K_M9.8 GB
GGUF
QW
Qwen3 14B
Qwen · Aldaris
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5 27B RpRMax v1
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3.5 27B Abliterated Ko
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
OM
Omni Edu 27B
Omni · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
FU
FusionNet_7Bx2_MoE_14B
Fusionnet · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF

Other sizes

Keep browsing