Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
WH
whiterabbitneo_whiterabbitneo-33b-v1
Whiterabbitneo · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
QW
Qwen3.8-27B
Qwen · k1lliiviie
Params27.3B
Context256K
Q4_K_M16.6 GB
CE
MN 12B Celeste V1.9
Celeste · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CY
Cydonia 24B v4.2.0
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
ER
10Eros Max Hybrid Beta5
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
QW
Huihui Qwen3.6 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CR
Creative Quants
Creative · drakira
Params11.9B
Context256K
Smallest8.6 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Nemotron 3 Nano 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
RU
rune 26b a4b v3
Rune · Livesport
Params25.2B
Context—
Smallest0.1 GB
OL
Olmo 3.1 32B Instruct
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
GE
Gemma 4 MoonGem 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
LL
DaringFortitude
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CY
Cyberdonia 24B v8
Cyberdonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
WI
Wicked Stuff 26B A4B v2.0 Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
HI
HiDream I1 Full
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
QW
Qwen3.6 27B Architect Polaris2 Fable B F451 heretic
Qwen · mcgonzo
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8-27B
Qwen · NilVoid
Params27.3B
Context256K
Q4_K_M16.6 GB
LL
Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.6 27B Uncensored Heretic v2 Native MTP Preserved
Qwen · llmfan46
Params27.3B
Context256K
Q4_K_M17.2 GB
QW
Qwen3.6 27B
Qwen · AtomicChat
Params26.9B
Context256K
Q4_K_M16.5 GB
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QU
Quen32
Quen · AlSamCur123
Params32.8B
Context—
Smallest15.6 GB
LL
LLaDa Image Turbo ComfyUI
Llada · realrebelai
Params16.3B
Context—
Q4_K_M9.2 GB
MI
Mistral Heretica 12B
Mistral · AnkitAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8-27B
Qwen · ahmed-amedo
Params27.3B
Context256K
Q4_K_M16.6 GB
CY
Cydonia 24B v4.3 Absolute Heresy
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB