Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen3-Vl-32B-Instruct-1M
Qwen · unsloth
Params32.8B
Context977K
Q4_K_M19.8 GB
RE
Redmond Puffin 13B
Redmond · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LE
leolm_leo-hessianai-13b-chat-bilingual
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
CA
CarbonVillain en 10.7B v4
Carbonvillain · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
BR
Breeze-13B-32k-Instruct-v1_0
Breeze · mradermacher
Params12.7B
Context32K
Q4_K_M7.7 GB
QW
Qwen3 14B Abliterated
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
LA
Lambda 17b PcDPO
Lambda · mradermacher
Params16.8B
Context32K
Q4_K_M10.3 GB
TH
TherapyBeagle 11B v1 i1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GE
Gemma 4 31B Loki Scotoma V2.0 Swa 4096
Gemma · CrucibleLab
Params30.7B
Context256K
Q4_K_M18.7 GB
FL
FLUX.1 dev
Flux · gpustack
Params17B
Context—
Smallest10.1 GB
PP
pplx decider 27B Artemis
Pplx · turintech
Params26.9B
Context256K
Smallest14.3 GB
AR
Artemis 31B v1.1 Heretic v2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ER
ERNIE 4.5 21B A3B PT
Ernie · bartowski
Params21.8B
Context128K
Q4_K_M13.5 GB
GE
gemma 4 31B it qat uncensored heretic UDmerge
Gemma · EZForever
Params30.7B
Context256K
Smallest17.3 GB
FA
MN 12B Faun RP RU
Faun · limloop
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small 3.2 24B Instruct 2506 ultra uncensored heretic
Mistral · llmfan46
Params23.6B
Context128K
Q4_K_M14.3 GB
CA
CarbonVillain En 10.7B v4
Carbonvillain · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SU
sulphur 2
Sulphur · szwagros
Params21B
Context—
Q4_K_M14.2 GB
EK
Ekbasis Skopos 27B
Ekbasis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
LU
luxia 21.4b alignment v1.0
Luxia · MaziyarPanahi
Params21.4B
Context32K
Q4_K_M12.9 GB
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ME
Medgemma 27b Text It Abliterated
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
WA
WaifuGemma4 26b A4B v1
Waifugemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GL
GLM 4.7 Flash Heretic
GLM · Olafangensan
Params29.9B
Context198K
Q4_K_M18.1 GB
MI
Magistral Small 2509
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
FR
Froopert 31B
Froopert · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
QW
Huihui Qwen3.8 27B Coder390 EfficientThink abliterated VAL APEX I NanoPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Smallest12.2 GB