Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
VE
VecGlypher 27b It
Vecglypher · wahidmounir
Params27B
Context128K
Q4_K_M16.5 GB
BO
Borealis Open 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
LU
Lumimaid Magnum v4 12B
Lumimaid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
CH
Chaotic Order 24B V5
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
DarkIdol Qwen3.8 27B v1.1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
DA
Dark Scarlett 27B v2.0
Dark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 27b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params27B
Context128K
Smallest15.9 GB
MU
Muse Glimmer 30B AZ Focus
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
Qwen3 14B NSFW FDA
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
upstage_llama-30b-instruct-2048
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GP
SpaceQA Gpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LF
LFM2 24B A2B
Lfm · bartowski
Params23.8B
Context125K
Q4_K_M14.4 GB
CY
Cydonia 22B v1.2
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen2.5 32B Instruct abliterated v2
Qwen · zetasepic
Params32.8B
Context32K
Q4_K_M19.9 GB
IN
Internlm2 Math Plus 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
QW
Suri Qwen 3.8 27B Neuro
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ME
G4 MeroMero v2 31B
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
FI
FimbMoister 11Range i1
Fimbmoister · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
CO
Codex 24B Small 3.2
Codex · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
CA
Captain Eris Twighlight V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
HY
Hy MT2 30B A3B
mradermacher
Params30B
Context256K
Q4_K_M18.2 GB
QW
Qwen2.5 Coder 14B Instruct AWQ
Qwen · EasierAI
Params14.8B
Context128K
Q4_K_M9.0 GB
DU
dulia 13b 8k alpha i1
Dulia · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
TE
TerminalHorizon 27B
Terminalhorizon · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
AI
Airoboros L2 13B 2.2
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GR
Groot 19B A3B 261023
Groot · mradermacher
Params19B
Context256K
Q4_K_M11.7 GB
QW
Ostrich 27B 261008 Qwen3.8 Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
LB
LBS 27B
Lbs · bartowski
Params26.9B
Context256K
Q4_K_M17.2 GB
TW
Twilight Embrace 31B Heretic
Twilight · alexokita
Params30.7B
Context256K
Q4_K_M18.7 GB