Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
NS
NSFW 13B sft
Nsfw · tastypear
Params13.3B
Context4K
Q4_K_M8.6 GB
LL
llm jp 3.1 13b instruct4
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · tatekuperus
Params27B
Context256K
Q4_K_M18.0 GB
KE
cognition ai Kevin 32B
Kevin · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
LF
LFM2 12B A1B SpeedDemon The Deckard II HERETIC Uncensored
Lfm · mradermacher
Params11.3B
Context125K
Q4_K_M6.8 GB
GE
gemma 4 31B it qat q4 0 uncensored heretic
Gemma · llmfan46
Params30.7B
Context256K
Smallest17.7 GB
GL
GLM 4 32B Base 32K
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
CH
Chronomaid Storytelling 13B
Chronomaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SH
Shisutemu Masuta Q3 32B
Shisutemu · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
DE
Deepseek Wizard 33B slerp
DeepSeek · mradermacher
Params17.4B
Context16K
Q4_K_M10.5 GB
PU
PuddleJumper 13B V2
Puddlejumper · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen2.5 Coder 32B Abliterated
Qwen · TobiasLogic
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
MY
MysticFusion 13B
Mysticfusion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.8 27B Humanlike Chat 2.0
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RS
RSR 27B
Rsr · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ST
MN Starlight Sylph 12B
Starlight · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
FL
FLUX.1 Fill dev
Flux · second-state
Params11.9B
Context—
Smallest4.2 GB
BO
Boulesis v2.1 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
SU
ariellee_superplatty-30b
Superplatty · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
UL
ultrareal-fine-tune.fp16.gguf
Ultrareal · void-gryph
Params11.9B
Context256
Q4_K_M6.7 GB
TE
bonsai 2 27b mtp
Ternary · decent-jawfish
Params27.3B
Context256K
Smallest7.6 GB
GE
gemma 4 26B A4B uncensored
Gemma · Riyan200324200324
Params25.2B
Context256K
Q4_K_M16.8 GB
SK
Skywork OR1 32B Preview
Skywork · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
FL
Q3.6 27B DS v4 Flash DA
Flash · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
WI
Wicked Tutu 26B A4B Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M18.6 GB
CA
MN CaptainErisNebula Chimera v1.1 THINKING ClaudeOpus4.5 12B Heretic Uncensored
Captainerisnebula · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
ANIMA Phi Neptune Mistral 10.7B
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
QW
ExpertLens Qwen3 VL 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB