Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
WH
whiterabbitneo_whiterabbitneo-33b-v1
Whiterabbitneo · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.8-27B
Qwen · k1lliiviie
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
CE
MN 12B Celeste V1.9
Celeste · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CY
Cydonia 24B v4.2.0
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
ER
10Eros Max Hybrid Beta5
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
QW
Huihui Qwen3.6 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
CR
Creative Quants
Creative · drakira
Params11.9B
Context256K
Smallest8.6 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
Nemotron 3 Nano 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
Coding
RU
rune 26b a4b v3
Rune · Livesport
Params25.2B
Context—
Smallest0.1 GB
GGUF
OL
Olmo 3.1 32B Instruct
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
GE
Gemma 4 MoonGem 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
RoleplayVision
LL
DaringFortitude
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CY
Cyberdonia 24B v8
Cyberdonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
QW
Qwen2.5 Coder 32B Instruct
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
Coding
WI
Wicked Stuff 26B A4B v2.0 Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
HI
HiDream I1 Full
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
GGUF
QW
Qwen3.6 27B Architect Polaris2 Fable B F451 heretic
Qwen · mcgonzo
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.8-27B
Qwen · NilVoid
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
LL
Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.6 27B Uncensored Heretic v2 Native MTP Preserved
Qwen · llmfan46
Params27.3B
Context256K
Q4_K_M17.2 GB
Vision
QW
Qwen3.6 27B
Qwen · AtomicChat
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QU
Quen32
Quen · AlSamCur123
Params32.8B
Context—
Smallest15.6 GB
GGUF
LL
LLaDa Image Turbo ComfyUI
Llada · realrebelai
Params16.3B
Context—
Q4_K_M9.2 GB
GGUF
MI
Mistral Heretica 12B
Mistral · AnkitAI
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
QW
Qwen3.8-27B
Qwen · ahmed-amedo
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
CY
Cydonia 24B v4.3 Absolute Heresy
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF

Other sizes

Keep browsing