Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
BA
Bamba 9B
Bamba · ibm-ai-platform
Params9.78B
Context—
Smallest19.6 GB
GGUF
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
WI
Wicked Stuff 12B
Wicked · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
LL
Llama 3.2 4X3B MOE Hell California Uncensored 10B
Llama · DavidAU
Params9.95B
Context128K
Q4_K_M6.1 GB
Roleplay
MI
Magistral-Small-2509
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningVision
QW
Qwen3.5 27B WebNovel Writer Zh
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
cerebras/Qwen3-Coder-REAP-25B-A3B
Qwen · bartowski
Params25B
Context256K
Q4_K_M15.2 GB
Coding
MI
Mistral Nemo Instruct 2407
Mistral · lmstudio-community
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TE
Bonsai-27B
Ternary · Hikari07jp
Params27B
Context256K
Smallest7.2 GB
GGUF
ME
Merousis 26B A4B
Merousis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
ME
Medgemma-27B-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision
GE
Gemma 4 12b RedTeam BlackICE
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
LU
G4 LuneLight 31B
Lunelight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
DA
MN DARKEST UNIVERSE 29B
Darkest · DavidAU
Params29.2B
Context1000K
Q4_K_M17.6 GB
Roleplay
QW
ThinkingCap Qwen3.6 27B abliterated MTP
Qwen · protoLabsAI
Params27.3B
Context—
Q4_K_M16.8 GB
Reasoning
AR
Artemis 31B v1.2 Abliterix
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
KI
Kimi VL A3B Instruct
Kimi · mradermacher
Params16B
Context128K
Q4_K_M10.5 GB
Vision
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen3.8-27B
Qwen · jj33512
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
KI
Kitchoon 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
MI
Ministral 3 14B Instruct 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
PH
dolphin-2.9.2-Phi-3-Medium
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
CodingTool use
QW
Qwen Image 2512
Qwen · Frederic75
Params20.4B
Context—
Q4_K_M13.0 GB
GGUF
QW
qwen image edit multiple angles
Qwen · ChrisColeTech
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
WI
Wicked Stuff 26B A4B Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.6 27B Uncensored Heretic v2
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
Vision
FL
krea
Flux · calcuis
Params11.9B
Context—
Q4_K_M7.1 GB
GGUF
QW
Bonsai 2 27B 1bit CRACK
Qwen · dealignai
Params27B
Context256K
Smallest5.9 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · CISCai
Params32.8B
Context32K
Smallest7.3 GB
Coding
DA
L3 DARKEST PLANET 16.5B
Darkest · DavidAU
Params16.5B
Context8K
Q4_K_M10.2 GB
Roleplay

Other sizes

Keep browsing