Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NO
Noromaid 13B v0.2
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
Gemma 4 12B It QAT SOMPOA Heresy
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
LF
Lfm25 24b
Lfm · PollardWeights
Params24B
Context128K
Smallest5.8 GB
GGUF
GE
Coder3101_Gemma_4_31B_It_Heretic
Gemma · Stabhappy
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingVision
GE
Gemma 4 26B A4B QAT Voice GGUFs
Gemma · alexisStacksCode
Params25.2B
Context128K
Smallest0.3 GB
ReasoningTool useVision
MI
Mistral Military 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PA
Pantheon Reasoning 26B A4B 1.1
Pantheon · bartowski
Params26B
Context256K
Q4_K_M17.5 GB
ReasoningRoleplay
MI
Ministral 3 14B Instruct 2512 BF16
Mistral · EnlistedGhost
Params13.5B
Context256K
Q4_K_M8.8 GB
Vision
GE
Huihui Gemma 4 12B Coder Fable5 Composer2.5 v1 Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningVision
QW
BiggerCoQ Qwen3 10b
Qwen · mradermacher
Params10.9B
Context40K
Q4_K_M6.6 GB
GGUF
SI
InnerJev 27B Full
Sii · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
SU
SuperNova Medius
Supernova · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
GE
Fallen Gemma3 12B v1
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
VI
MN Violet Lotus 12B
Violet · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
GE
Gemma 4 MoonGem 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
ZE
ZeusLabs Chronos Divergence 33B
Zeuslabs · RichardErkhov
Params32.5B
Context16K
Q4_K_M19.6 GB
GGUF
MX
MXLewd L2 20B
Mxlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
NU
Nu 17b
mradermacher
Params16.8B
Context32K
Q4_K_M10.3 GB
Roleplay
GL
Q3.6 27B GLM 5.1 DA
GLM · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
UP
upstage SOLAR 10.7B Instruct v1.0
Upstage · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
Gemma 4 12B It Qat Q4_0 Unquantized Heretic v1.1
Gemma · igorls
Params11.9B
Context256K
Smallest7.0 GB
GGUF
LL
Llama 3 13B Instruct v0.1
Llama · MaziyarPanahi
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
SK
SkyReels V2 T2V 14B 720P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Qwen2.5 Wolverine CODER 11B V2
Qwen · mradermacher
Params10.9B
Context32K
Q4_K_M6.6 GB
Coding
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · TopherAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
GE
Gemma4 Gutenberg Literotica 12B
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
Gemma 2 27b It
Gemma · ThomasBaruzier
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
BI
Bielik 11B v2.2 Instruct
Bielik · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
GR
Granite 20b Code Instruct 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use

Other sizes

Keep browsing