Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Deepseeker Kunou Qwen2.5 14b i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
LF
LFM2.5 24B A2B Uncensored
Lfm · pottokao
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
QW
Qwopus3.5 27B v3 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
MI
Pixtral
Mistral · ggml-org
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
OR
ddh0_orcamaidxl-17b-32k
Orcamaidxl · TheBloke
Params17.5B
Context32K
Q4_K_M10.5 GB
GGUF
LT
ltxv 13b 0.9.7 dev
Ltx · ThePun1sher
Params13B
Context—
Q4_K_M8.8 GB
GGUF
QW
Qwen2.5 32B AGI
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
LL
LLaMA2 13B Tiefighter i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
GR
Granite 34b Code Instruct 8k
Granite · RichardErkhov
Params33.7B
Context8K
Q4_K_M21.4 GB
Coding
GE
gemma 4 26B A4B it qat uncensored heretic UDmerge
Gemma · EZForever
Params25.2B
Context256K
Smallest14.2 GB
Vision
AI
Airochronos L2 13B
Airochronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
QwQ 32B Abliterated
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
LL
ShiningValiantXS 1.1
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
phind_phind-codellama-34b-v1
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LF
LFM2.5-24B-A2B
Lfm · ngquocvinh
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
WA
Wan2.1 T2V 14B LightX2V StepCfgDistill VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
GE
Tiger Gemma 12B v3
Gemma · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
NE
nexusflow_nexusraven-v2-13b
Nexusraven · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
MI
Mistral NeMo 12B Abliterated
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
Qwen3 Omni 30B A3B Captioner
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
GGUF
GR
granite 20b code instruct i1
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
TE
Ternary-Bonsai-2-27B-Uncensored
Ternary · gaston-parravicini
Params27B
Context256K
Smallest7.1 GB
Reasoning
LI
Linne Oak 1 0
Linne · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Tool useVision
TE
Ternary Bonsai 2 27B MTP
Ternary · ManniX-ITA
Params27.3B
Context256K
Smallest6.4 GB
GGUF
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
PA
Pantheon Reasoning 27B
Pantheon · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
ReasoningRoleplay
GE
Gemma 4 26B A4B
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
PY
Pythia 12b Deduped
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
GGUF
KE
Kev-27B Artemis 12.3GB
Kev · turintech
Params25.6B
Context256K
Smallest12.3 GB
ReasoningTool use
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · dongfangshuo
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision

Other sizes

Keep browsing