Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NS
NSFW 13B sft
Nsfw · tastypear
Params13.3B
Context4K
Q4_K_M8.6 GB
GGUF
LL
llm jp 3.1 13b instruct4
Llm · mmnga
Params13.7B
Context4K
Q4_K_M8.3 GB
GGUF
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · tatekuperus
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
KE
cognition ai Kevin 32B
Kevin · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
GGUF
LF
LFM2 12B A1B SpeedDemon The Deckard II HERETIC Uncensored
Lfm · mradermacher
Params11.3B
Context125K
Q4_K_M6.8 GB
CodingRoleplay
GE
gemma 4 31B it qat q4 0 uncensored heretic
Gemma · llmfan46
Params30.7B
Context256K
Smallest17.7 GB
Vision
GL
GLM 4 32B Base 32K
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
CH
Chronomaid Storytelling 13B
Chronomaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SH
Shisutemu Masuta Q3 32B
Shisutemu · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
DE
Deepseek Wizard 33B slerp
DeepSeek · mradermacher
Params17.4B
Context16K
Q4_K_M10.5 GB
Coding
PU
PuddleJumper 13B V2
Puddlejumper · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen2.5 Coder 32B Abliterated
Qwen · TobiasLogic
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
MY
MysticFusion 13B
Mysticfusion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.8 27B Humanlike Chat 2.0
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayTool useVision
RS
RSR 27B
Rsr · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
ST
MN Starlight Sylph 12B
Starlight · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
FL
FLUX.1 Fill dev
Flux · second-state
Params11.9B
Context—
Smallest4.2 GB
GGUF
BO
Boulesis v2.1 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
SU
ariellee_superplatty-30b
Superplatty · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
UL
ultrareal-fine-tune.fp16.gguf
Ultrareal · void-gryph
Params11.9B
Context256
Q4_K_M6.7 GB
GGUF
TE
bonsai 2 27b mtp
Ternary · decent-jawfish
Params27.3B
Context256K
Smallest7.6 GB
GGUF
GE
gemma 4 26B A4B uncensored
Gemma · Riyan200324200324
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
SK
Skywork OR1 32B Preview
Skywork · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
FL
Q3.6 27B DS v4 Flash DA
Flash · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
WI
Wicked Tutu 26B A4B Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M18.6 GB
ReasoningRoleplayTool use
CA
MN CaptainErisNebula Chimera v1.1 THINKING ClaudeOpus4.5 12B Heretic Uncensored
Captainerisnebula · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
ANIMA Phi Neptune Mistral 10.7B
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
QW
ExpertLens Qwen3 VL 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision

Other sizes

Keep browsing