Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
LT
LTX 2.5
Ltx · vantagewithai
Params21B
Context—
Q4_K_M15.7 GB
MA
magnum v4 12b
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small Instruct 2409
Mistral · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
AN
AnimeGen I2V
Animegen · NullpoLab
Params14.3B
Context—
Q4_K_M9.7 GB
QW
Qwen3 14B Claude 4.5 Opus High Reasoning Distill
Qwen · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
DE
deepseek-ai_deepseek-coder-33b-instruct
DeepSeek · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
GE
Gemma4 12B Uncensored LocalAI
Gemma · weareapexcreators
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3.8 3.6 27B blend
Qwen · JetBrains
Params27.3B
Context256K
Q4_K_M1.1 GB
BO
Bonsai-27B
Bonsai · weareapexcreators
Params27B
Context256K
Smallest3.8 GB
QW
Ingot genesis 27B Q2
Qwen · dendriteholdings
Params27B
Context256K
Smallest7.2 GB
QW
Ternary Bonsai 2 27B MTP
Qwen · ProCreations
Params27.3B
Context256K
Smallest7.7 GB
QW
Qwen 3.5 27B Derestricted
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
KR
Krea2 Turbo HD V1
Krea · wikeeyang
Params12.8B
Context—
Smallest7.9 GB
QW
Qwen3.5 27B WebNovel Writer Zh
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MU
Muse-Glimmer-30B
Muse · AtomicChat
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8-27B
Qwen · weareapexcreators
Params27.3B
Context256K
Smallest10.7 GB
QW
Qwen3.5 27B WebNovel Writer zh
Qwen · wcn123
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 30B A3B Abliterated
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
MU
Muse-Glimmer-30B
Muse · weareapexcreators
Params28B
Context128K
Smallest12.4 GB
QW
Qwen3.8 27B Uncensored FIT
Qwen · SC117
Params27B
Context256K
Smallest7.5 GB
NA
Nanbeige4.3 33B
Nanbeige · abenzerps
Params33.1B
Context512K
Smallest9.9 GB
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Smallest12.1 GB
TR
Translategemma 12b It
Translategemma · bullerwins
Params11.8B
Context128K
Q4_K_M7.3 GB
WA
WaifuGemma4 26b a4b v1 i1
Waifugemma · hiwaifu-research
Params25.2B
Context256K
Q4_K_M16.8 GB
BA
Bamboo 1 LocalAI
Bamboo · weareapexcreators
Params11.9B
Context256K
Q4_K_M7.4 GB
HE
Hemmingway 1 Heretic MTP V3 Final
Hemmingway · brainnxdomain
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B S mirai
Qwen · alesha-pro
Params27B
Context—
Smallest0.0 GB