Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
CA
Captain Eris Diogenes Twilight V0.420 12B GGUF ARM Imatrix
Captain · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemma 4 Gemsicle 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
PS
PsyMedLewdReMM Inverted 20B
Psymedlewdremm · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
QW
Qwen2.5 Coder 14B Instruct Uncensored Patched
Qwen · SSDD145
Params14.8B
Context32K
Q4_K_M9.0 GB
WA
Wayfarer 2 12B Absolute Heresy
Wayfarer · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
Models Qwen Qwen2.5 32B Instruct
Qwen · MaziyarPanahi
Params32.8B
Context32K
Q4_K_M19.9 GB
GP
Gpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
MI
Mistral Nemo Prism 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
KI
Kiwen1.1 27B
Kiwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ME
Melody1437 26B A4B
Melody · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 12B It Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
NE
Nemo Gutenberg 12b v1
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Dolphin3.0 Mistral 24B
Mistral · rax4901
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen3.6 27B Omnimerge v4 MTP
Qwen · ManniX-ITA
Params27.3B
Context256K
Q4_K_M16.8 GB
LF
Abliterated
Lfm · alexwkleung
Params24B
Context128K
Q4_K_M14.5 GB
LE
LeoLM hessianai 13b
Leolm · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
CO
comfyui image models
Comfyui · ChuuniZ
Params11.9B
Context—
Smallest6.8 GB
CH
chronos 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MO
Moe 4x7b reason code qa i1
Moe · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
JE
Jev-Omni
Jev · ngquocvinh
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
WebWorld 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GE
gemma 4 12B agentic fable5 composer2.5 v2 3.5x tau2
Gemma · Acelogicdev
Params11.9B
Context256K
Q4_K_M7.4 GB
OP
openbuddy-zero-14b-v22.3-32k
Openbuddy · mradermacher
Params14B
Context32K
Q4_K_M8.4 GB
QW
Qwen2.5 14B_Uncencored_Instruct
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · DhruvalLabs
Params30.5B
Context256K
Q4_K_M18.6 GB
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwen Qwen3.8 27B GGUF IQ1 S
Qwen · sigmanih
Params27.3B
Context256K
Smallest0.1 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · LoneStriker
Params15.7B
Context160K
Q4_K_M10.4 GB
NO
NovaSage 24B
Novasage · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB