Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 27B Instruct Uncensored
Qwen · backpropSukuna
Params27B
Context256K
Q4_K_M16.5 GB
LO
LogicLumina-L3-13B-v2
Logiclumina · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AP
Apriel 1.5 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
QW
Qwen3.8 27B Heretic Uncensored Q8 0
Qwen · mlasli
Params27.3B
Context256K
Smallest29.0 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · arbonquants
Params26.9B
Context256K
Q4_K_M18.0 GB
DI
DISC LawLLM
Disc · mradermacher
Params13.3B
Context4K
Q4_K_M8.6 GB
CH
Chewy-Lemon-Cookie-11B
Chewy · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
PY
Pythia 12b Deduped
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
GE
Gemma 2 27b It
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
LI
Ling Mini 2.0
Ling · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
MI
Codestral-21B-Pruned
Mistral · mradermacher
Params21.5B
Context32K
Q4_K_M12.8 GB
MI
MiroThinker 1.7 Mini
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
DR
DRT O1 14B
Drt · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
SC
Schisandra
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MA
Magnum Picaro 0.7 v2 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
heretic1
Qwen · briancollet
Params27B
Context256K
Q4_K_M18.0 GB
QW
Qwen3.5 27B Deckard PKD Heretic Uncensored Thinking
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
NE
Neuraltranslate 27b Mt Nah Es v1
Neuraltranslate · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
NE
Nemotron 3.5 Lightning 30B A3B Uncensored xCloud
Nemotron · xCloudinfo
Params32.9B
Context1024K
Q4_K_M25.4 GB
RE
Rei 12B V3 Base
Rei · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B abliterated
Nemotron · IstroSec
Params32.9B
Context1024K
Smallest0.1 GB
CA
CARA Sage 24B
Cara · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GL
GLM 4.7 Flash Derestricted
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
CY
CyberPal-2.0-20B
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
MI
Mistral Nemo Instruct 2407
Mistral · unsloth
Params12.2B
Context1000K
Q4_K_M7.5 GB
LT
LTX 2.3 uncensored v1.4 FP8
Ltx · 0xSojalSec
Params21B
Context128K
Q4_K_M7.3 GB
CH
chronoboros 33B i1
Chronoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
MI
Devstral Small 2507 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
MiniMax H3 GGUFs
Minimax · FenomAI
Params33.1B
Context—
Q4_K_M14.6 GB
QW
Qwen3.8 27B Uncensored
Qwen · dancinlab
Params27.3B
Context256K
Q4_K_M16.8 GB