Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TO
tokyotech llm Swallow 13b instruct hf
Tokyotech · RichardErkhov
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
CH
austism_chronos-wizardlm-uc-scot-st-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
QW
qwen3.5 35b a3b compacted
Qwen · cahlen
Params23.5B
Context256K
Q4_K_M14.4 GB
GGUF
QI
QiMing CognitiveForge 14B
Qiming · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
PocketWeights Qwen2.5 14B Coder Creative
Qwen · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
Coding
UN
Underdog Ternary 1.1
Underdog · ConwayResearch
Params27B
Context256K
Smallest7.2 GB
GGUF
FO
Foresight 32B
Foresight · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · AI-conn
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
MI
allura org Mistral Small Sisyphus 24b 2503
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoning
HA
Hamanasu 15B Adventure i1
Hamanasu · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Roleplay
GE
Gemma 4 26B A4B It Claude Opus Distill
Gemma · TeichAI
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
GR
Granite 20b Code Base 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
Coding
MI
Devstral Small 2505 Abliterated
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
MA
Magidonia 24B v4.3 Heretic v3
Magidonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
Candid 3.5
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.9 GB
Reasoning
GE
Gemma 3 12b It Vl GLM 4.7 Flash Polaris Thinking Heretic Uncensored
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GL
GLM 4.7 Flash heretic
GLM · ThalisAI
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
QW
Qwen3.8 27B OBLITERATED 12GB
Qwen · cognitivers
Params27.3B
Context—
Smallest0.0 GB
GGUF
LT
joyai echo ltx25 echoVid
Ltx · joeygambino
Params21B
Context—
Q4_K_M14.2 GB
GGUF
LL
Llama 3.2 8X3B GATED MOE NEO Reasoning Dark Champion uncensored 18.4B IMAT
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.3 GB
ReasoningRoleplay
GE
Gemma 4 Gembrain X 31B
Gemma · Nimbz
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
GR
Granite 20b Code Base
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
Coding
MI
Magistral Small 2507 Rebased Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningVision
AU
Austral 24B Winton
Austral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
MI
MiniMax H3 Hybrid b25 49
Minimax · hoidhxd
Params20.1B
Context—
Smallest11.4 GB
GGUF
LL
Llama 2 13b Hf
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GP
Gpt-Oss-Safeguard-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
GGUF
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
QW
Swift 1.5 Qwen3.8 27b Heretic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
AR
Artemis 31B v1.2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision

Other sizes

Keep browsing