Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 14B Abliterated Conservative
Qwen · richardyoung
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
HO
Holo4 27B
Holo · Hcompany
Params27B
Context256K
Q4_K_M16.9 GB
Vision
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · AtomicChat
Params32.9B
Context1024K
Q4_K_M25.0 GB
ReasoningTool use
LL
testmod koen llama2 13b dpotrain testver
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
GGUF
QW
Qwen2.5 Coder 32b Instruct Heretic Sft
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
KR
krea 2
Krea · gguf-org
Params12.8B
Context—
Smallest0.3 GB
GGUF
QW
Qwen3.6 35B A3b pruned v2
Qwen · gatilin
Params26.6B
Context256K
Smallest16.3 GB
GGUF
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · noctrex
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
AR
BAAI AREX 2
Arex · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
ReasoningTool useVision
QW
Qwen3.8 Whittle MoE 27B A17.8B
Qwen · logic65
Params26.9B
Context256K
Q4_K_M17.4 GB
Vision
QW
Qwen3.8 27B Heretic JP Roleplay NSFW
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
RoleplayVision
KR
Krea 2 Turbo
Krea · byteshape
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
WA
Wan2.2 T2V A14B
Wan · bullerwins
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
Qwen3 128k 30B A3B NEO MAX Imatrix
Qwen · DavidAU
Params30.5B
Context128K
Q4_K_M18.6 GB
ReasoningRoleplayTool use
QW
Qwen3 14B Abliterated
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Therapy 3.8
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
GI
GigaChat3.1 10B A1.8B
Gigachat · ai-sage
Params10.7B
Context256K
Q4_K_M6.5 GB
Tool use
KI
Kitchoon V3 26B A4B
Kitchoon · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled v2
Qwen · Jackrong
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
JE
JEV 27B VL
Jev · Atlas3D
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3 30B A3B
Qwen · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
GGUF
ST
StartLux-Decision-v1.1-27B-Instant
Startlux · startlux-models
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.8-27B-DFlash2
Qwen · perplexity-ai
Params27.3B
Context256K
Q4_K_M1.1 GB
Vision
TE
Test Frankenstein
Test · ND911
Params11.9B
Context—
Smallest6.9 GB
GGUF
GE
Gemma 3 12b It
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Sprinkle Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3.8
Qwen · cHunter789
Params27B
Context256K
Smallest14.8 GB
Vision
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay

Other sizes

Keep browsing