Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
VE
VecGlypher 27b It
Vecglypher · wahidmounir
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
BO
Borealis Open 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
LU
Lumimaid Magnum v4 12B
Lumimaid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
CH
Chaotic Order 24B V5
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
DarkIdol Qwen3.8 27B v1.1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayVision
DA
Dark Scarlett 27B v2.0
Dark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
GE
Gemma 3 27b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params27B
Context128K
Smallest15.9 GB
Vision
MU
Muse Glimmer 30B AZ Focus
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
ReasoningTool use
QW
Qwen3 14B NSFW FDA
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
LL
upstage_llama-30b-instruct-2048
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GP
SpaceQA Gpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
LF
LFM2 24B A2B
Lfm · bartowski
Params23.8B
Context125K
Q4_K_M14.4 GB
GGUF
CY
Cydonia 22B v1.2
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
QW
Qwen2.5 32B Instruct abliterated v2
Qwen · zetasepic
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
IN
Internlm2 Math Plus 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
QW
Suri Qwen 3.8 27B Neuro
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
ME
G4 MeroMero v2 31B
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
FI
FimbMoister 11Range i1
Fimbmoister · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CO
Codex 24B Small 3.2
Codex · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
CA
Captain Eris Twighlight V0.420 12B
Captain · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HY
Hy MT2 30B A3B
mradermacher
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct AWQ
Qwen · EasierAI
Params14.8B
Context128K
Q4_K_M9.0 GB
Coding
DU
dulia 13b 8k alpha i1
Dulia · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
TE
TerminalHorizon 27B
Terminalhorizon · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Vision
AI
Airoboros L2 13B 2.2
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
GR
Groot 19B A3B 261023
Groot · mradermacher
Params19B
Context256K
Q4_K_M11.7 GB
ReasoningTool use
QW
Ostrich 27B 261008 Qwen3.8 Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
LB
LBS 27B
Lbs · bartowski
Params26.9B
Context256K
Q4_K_M17.2 GB
ReasoningTool useVision
TW
Twilight Embrace 31B Heretic
Twilight · alexokita
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay

Other sizes

Keep browsing