Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
QW
GrayLine Qwen3 14B
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
ME
Mellum2 12B A2.5B Thinking
Mellum · bartowski
Params12.1B
Context128K
Q4_K_M8.2 GB
Reasoning
SA
SauerkrautLM 13B v1
Sauerkrautlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
SE
Serenity 27B
Serenity · ReadyArt
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
SU
Sulphur 2 base
Sulphur · Abiray
Params21B
Context—
Q4_K_M14.3 GB
GGUF
TO
llm-agents_tora-code-34b-v1.0
Tora · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
Llama 2 13B Chat
Llama · second-state
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SW
Swallow 13B
Swallow · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
CH
Chronos Gold 12B 1.0
Chronos · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GE
Gemma 4 31B Fable 5 Agent Distill
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Coding
JP
jpacifico Chocolatine 14B Instruct DPO v1.2
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
BO
Borealis 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
CY
CyberStag Security 26B A4B V1 Uncensored Heretic
Cyberstag · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Reasoning
SO
SOLAR 10.7B v1.0
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
YO
Yousei-22B
Yousei · mradermacher
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506 Absolute Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
Qwen3.8 27B Ultra Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
DE
DeepSeek-V4-Flash-DSpark-Drafter
DeepSeek · alessandrobologna
Params19.8B
Context—
Smallest7.0 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct AWQ
Qwen · EasierAI
Params32.8B
Context128K
Q4_K_M19.9 GB
Coding
CY
Cydonia R1 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
BA
Basal Omni 1.0 Ultra
Basal · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
Vision
GE
Amoral Gemma3 12B v2
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
WA
Phantom Wan 14B FusionX
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
MY
MythoMax L2 13b i1
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
QW
Qwen3.8-27B
Qwen · YTan2000
Params27.3B
Context256K
Smallest14.5 GB
Vision
GL
GLM Z1 Rumination 32B 0414
GLM · bartowski
Params33.1B
Context128K
Q4_K_M20.0 GB
GGUF
MI
Dolphin-Mistral-24B-Venice-Edition
Mistral · Mungert
Params23.6B
Context32K
Q4_K_M14.5 GB
GGUF

Other sizes

Keep browsing