Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 VL 32B Instruct
Qwen · ggml-org
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
Qwen3.6 35B A3B REAP 48 v2
Qwen · crucible-labs
Params19.2B
Context256K
Smallest9.4 GB
Tool use
OR
Ornith 1.5 REAP 20B A3B
Ornith · sleepyeldrazi
Params19B
Context256K
Smallest10.5 GB
ReasoningTool use
LF
LFM2.5 24B A2B Nyquant Q4 preview
Lfm · XGeorgeCostanzaX
Params24B
Context128K
Smallest12.0 GB
GGUF
HY
HybridAgent 14B Agentic
Hybridagent · bartowski
Params14.8B
Context32K
Q4_K_M9.3 GB
ReasoningTool use
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
GE
Gemma 4 12B StyleTune
Gemma · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
Roleplay
KI
Kiwen1.1 27B
Kiwen · NikiKrutan
Params27.3B
Context256K
Smallest8.9 GB
ReasoningVision
LL
CodeLlama 34b Python Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
CY
TheDrummer Cydonia 24B v2
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
QW
dnotitia_Smoothie Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen2.5 Coder 14B Instruct Uncensored
Qwen · BlossomsAI
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
TR
Trurl 2 13B
Trurl · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Starcoder
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding
GU
Guanaco 13B Uncensored i1
Guanaco · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Logics SWE Qwen3.6 27B
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
QW
Qwen3 14B
Qwen · lm-kit
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
DE
Decision 2.0 Vega 27B
Decision · vllm-sr
Params25.6B
Context32K
Q4_K_M15.9 GB
GGUF
FI
Fimbulvetr 11B v2 i1
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
GGUF
GE
Gemma 4 12B Agentic Fable5 Composer2.5 v2 3.5x Tau2 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
AI
Airoboros L2 13B 3.1.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled Heretic
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
TE
Tencent Hy MT2 30B A3B
litigerking
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
OR
Orion 26B A4B v1.1
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma 4 Queen 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
RU
surogate rune 26b a4b
Rune · owao
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
KR
Kroma v0.3.1 Turbo OPD
Kroma · Abiray
Params12.8B
Context—
Q4_K_M8.8 GB
GGUF
DI
Diffusiongemma 26B A4B It HERETIC Uncensored
Diffusiongemma · yabaimimi
Params25.3B
Context256K
Q4_K_M16.8 GB
GGUF
MI
Mia v2 29B
Mia · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF

Other sizes

Keep browsing