Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
CH
MN CharThink 12B Base
Charthink · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
FU
FuseChat-Kunoichi-10.7B
Fusechat · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
LL
ShiningValiantXS i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.4 GB
SE
Serenity 12B
Serenity · ReadyArt
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3 16B A3B
Qwen · bartowski
Params16B
Context40K
Q4_K_M9.8 GB
PE
Q3 30b A3b Pentiment
Pentiment · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
HE
Hemmingway 1.5 Unlocked
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 14B RefusalDirection ThinkingAware
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
SC
Schattenblume 31B
Schattenblume · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
KA
Karen_theEditor_13b_HF
Karen · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
CL
claude2 alpaca 13B
Claude · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GE
Gemma 4 Gembrain 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LI
Ling Mini 2.0
Ling · inclusionAI
Params16.3B
Context32K
Q4_K_M9.9 GB
ME
Abliterated
Mellum · alexwkleung
Params12.1B
Context128K
Q4_K_M8.1 GB
LO
LogicLumina-L3-13B
Logiclumina · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
WA
Waifu Heretic 26b A4B
Waifu · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
LR
OrionLLM LRM 3.2
Lrm · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
GE
Gemma 4 26B A4B It Claude Opus Distill v2
Gemma · TeichAI
Params25.2B
Context256K
Q4_K_M16.8 GB
TE
jev Ternary Bonsai 2 27B Abliterated PTQ1 0
Ternary · hotdogs
Params27B
Context256K
Smallest5.9 GB
QW
Qwen3 The Josiefied Omega Directive 22B Uncensored Abliterated
Qwen · mradermacher
Params22B
Context40K
Q4_K_M13.3 GB
LO
MN LooseCannon 12B v2 i1
Loosecannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GI
GigaChat3 10B A1.8B
Gigachat · bartowski
Params10.7B
Context256K
Q4_K_M6.7 GB
WI
WizardLM 13B V1.2
Wizardlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
FL
FLUX.1 schnell
Flux · Haijun-AI
Params17B
Context—
Smallest10.0 GB
MI
Mistral Nemo Inst 2407 12B Thinking Uncensored HERETIC HI Claude Opus
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GP
Gpt Oss 20b
gpt-oss · SoAIHQ
Params20.9B
Context128K
Smallest13.8 GB
PA
Pantheon Rp 1.6.1 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
KA
KAT Coder V2.5 Dev REAP 50
Kat · Ttimms
Params18.5B
Context256K
Q4_K_M11.4 GB