Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLaMA2-13B-Psyfighter2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
GEV 26B Decide
Gev · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
CH
Chaotic Harmony 24B
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
OP
OpenOrca Platypus2 13B
Openorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TE
TerminalHorizon 27B
Terminalhorizon · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
GE
Gemma 4 26B A4B StyleTune QK Heretic
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
GE
burtenshaw GemmaCoder3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingReasoning
ON
OneJev 27B
Onejev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
LL
Llama 30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
YO
You can cry Snowman 13B
You · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
GE
Gemma 4 Garnet V2 31B It Ultra Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
LY
MN 12B Lyra v4
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HU
hyvid
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
WR
writing roleplay 20k context nemo 12b v1.0
Writing · openerotica
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GR
Grug 27b v1.1
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
ReasoningTool useVision
GP
Gpt Oss 20b Derestricted
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
SL
SlimOrca 13B
Slimorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
gemma 4 12B it Claude 4.6 4.8 Opus
Gemma · yuxinlu1
Params11.9B
Context128K
Q4_K_M7.4 GB
Reasoning
MI
MiniMax H3 GGUF MiniStack
Minimax · woodfireind
Params20.1B
Context256K
Q4_K_M2.5 GB
GGUF
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
Roleplay
QW
Qwen3.8 27B
Qwen · zugquants
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
OM
OmniDimen 2 20B Emotion
Omnidimen · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
AT
Athena v4 i1
Athena · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
AI
Airolima Chronos Grad L2 13B
Airolima · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RP
rpguild chatml 13B
Rpguild · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
ME
merlyn education corpus qa v2
Merlyn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
FA
Falcon3 10B Instruct Abliterated
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF

Other sizes

Keep browsing