Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 27B Instruct Uncensored
Qwen · backpropSukuna
Params27B
Context256K
Q4_K_M16.5 GB
Vision
LO
LogicLumina-L3-13B-v2
Logiclumina · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AP
Apriel 1.5 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
QW
Qwen3.8 27B Heretic Uncensored Q8 0
Qwen · mlasli
Params27.3B
Context256K
Smallest29.0 GB
Roleplay
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · arbonquants
Params26.9B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
DI
DISC LawLLM
Disc · mradermacher
Params13.3B
Context4K
Q4_K_M8.6 GB
GGUF
CH
Chewy-Lemon-Cookie-11B
Chewy · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
Roleplay
PY
Pythia 12b Deduped
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
GGUF
GE
Gemma 2 27b It
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LI
Ling Mini 2.0
Ling · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
MI
Codestral-21B-Pruned
Mistral · mradermacher
Params21.5B
Context32K
Q4_K_M12.8 GB
Coding
MI
MiroThinker 1.7 Mini
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
DR
DRT O1 14B
Drt · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
SC
Schisandra
Schisandra · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
MA
Magnum Picaro 0.7 v2 12b i1
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
heretic1
Qwen · briancollet
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3.5 27B Deckard PKD Heretic Uncensored Thinking
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplay
NE
Neuraltranslate 27b Mt Nah Es v1
Neuraltranslate · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
NE
Nemotron 3.5 Lightning 30B A3B Uncensored xCloud
Nemotron · xCloudinfo
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
RE
Rei 12B V3 Base
Rei · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B abliterated
Nemotron · IstroSec
Params32.9B
Context1024K
Smallest0.1 GB
GGUF
CA
CARA Sage 24B
Cara · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GL
GLM 4.7 Flash Derestricted
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
CY
CyberPal-2.0-20B
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · unsloth
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LT
LTX 2.3 uncensored v1.4 FP8
Ltx · 0xSojalSec
Params21B
Context128K
Q4_K_M7.3 GB
GGUF
CH
chronoboros 33B i1
Chronoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
GGUF
MI
Devstral Small 2507 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
MI
MiniMax H3 GGUFs
Minimax · FenomAI
Params33.1B
Context—
Q4_K_M14.6 GB
GGUF
QW
Qwen3.8 27B Uncensored
Qwen · dancinlab
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision

Other sizes

Keep browsing