Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
GrayLine Qwen3 14B
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
ME
Mellum2 12B A2.5B Thinking
Mellum · bartowski
Params12.1B
Context128K
Q4_K_M8.2 GB
SA
SauerkrautLM 13B v1
Sauerkrautlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
SE
Serenity 27B
Serenity · ReadyArt
Params27.3B
Context256K
Q4_K_M16.8 GB
SU
Sulphur 2 base
Sulphur · Abiray
Params21B
Context—
Q4_K_M14.3 GB
TO
llm-agents_tora-code-34b-v1.0
Tora · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
Llama 2 13B Chat
Llama · second-state
Params13B
Context4K
Q4_K_M7.9 GB
SW
Swallow 13B
Swallow · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
CH
Chronos Gold 12B 1.0
Chronos · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemma 4 31B Fable 5 Agent Distill
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
JP
jpacifico Chocolatine 14B Instruct DPO v1.2
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
BO
Borealis 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
CY
CyberStag Security 26B A4B V1 Uncensored Heretic
Cyberstag · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
SO
SOLAR 10.7B v1.0
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
YO
Yousei-22B
Yousei · mradermacher
Params21.8B
Context4K
Q4_K_M13.2 GB
MI
Mistral Small 3.2 24B Instruct 2506 Absolute Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8 27B Ultra Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
DE
DeepSeek-V4-Flash-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
QW
Qwen2.5 Coder 32B Instruct AWQ
Qwen · EasierAI
Params32.8B
Context128K
Q4_K_M19.9 GB
CY
Cydonia R1 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
BA
Basal Omni 1.0 Ultra
Basal · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
GE
Amoral Gemma3 12B v2
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
WA
Phantom Wan 14B FusionX
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
MY
MythoMax L2 13b i1
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
QW
Qwen3.8-27B
Qwen · YTan2000
Params27.3B
Context256K
Smallest14.5 GB
GL
GLM Z1 Rumination 32B 0414
GLM · bartowski
Params33.1B
Context128K
Q4_K_M20.0 GB
MI
Dolphin-Mistral-24B-Venice-Edition
Mistral · Mungert
Params23.6B
Context32K
Q4_K_M14.5 GB