Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
MN CharThink 12B Base
Charthink · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
FU
FuseChat-Kunoichi-10.7B
Fusechat · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
LL
ShiningValiantXS i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.4 GB
GGUF
SE
Serenity 12B
Serenity · ReadyArt
Params11.9B
Context256K
Q4_K_M7.4 GB
Roleplay
QW
Qwen3 16B A3B
Qwen · bartowski
Params16B
Context40K
Q4_K_M9.8 GB
GGUF
PE
Q3 30b A3b Pentiment
Pentiment · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
Roleplay
HE
Hemmingway 1.5 Unlocked
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
Qwen3 14B RefusalDirection ThinkingAware
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
SC
Schattenblume 31B
Schattenblume · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
KA
Karen_theEditor_13b_HF
Karen · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
CL
claude2 alpaca 13B
Claude · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
Gemma 4 Gembrain 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
LI
Ling Mini 2.0
Ling · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
ME
Abliterated
Mellum · alexwkleung
Params12.1B
Context128K
Q4_K_M8.1 GB
CodingReasoning
LO
LogicLumina-L3-13B
Logiclumina · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WA
Waifu Heretic 26b A4B
Waifu · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
LR
OrionLLM LRM 3.2
Lrm · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
ReasoningVision
GE
Gemma 4 26B A4B It Claude Opus Distill v2
Gemma · TeichAI
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
TE
jev Ternary Bonsai 2 27B Abliterated PTQ1 0
Ternary · hotdogs
Params27B
Context256K
Smallest5.9 GB
Vision
QW
Qwen3 The Josiefied Omega Directive 22B Uncensored Abliterated
Qwen · mradermacher
Params22B
Context40K
Q4_K_M13.3 GB
Roleplay
LO
MN LooseCannon 12B v2 i1
Loosecannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GI
GigaChat3 10B A1.8B
Gigachat · bartowski
Params10.7B
Context256K
Q4_K_M6.7 GB
GGUF
WI
WizardLM 13B V1.2
Wizardlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FL
FLUX.1 schnell
Flux · Haijun-AI
Params17B
Context—
Smallest10.0 GB
GGUF
MI
Mistral Nemo Inst 2407 12B Thinking Uncensored HERETIC HI Claude Opus
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
GP
Gpt Oss 20b
gpt-oss · SoAIHQ
Params20.9B
Context128K
Smallest13.8 GB
Tool useVision
PA
Pantheon Rp 1.6.1 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
KA
KAT Coder V2.5 Dev REAP 50
Kat · Ttimms
Params18.5B
Context256K
Q4_K_M11.4 GB
Coding

Other sizes

Keep browsing