Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Saiga_Nemo_12B_Sft_M10_D16
Saiga · IlyaGusev
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GA
GameScaling 27B S3
Gamescaling · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
IN
Ingot IX 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
ReasoningTool use
PA
MS3.2 PaintedFantasy Visage v2 33B
Paintedfantasy · bartowski
Params33.6B
Context128K
Q4_K_M20.4 GB
GGUF
DA
Davinci Tool 30B
Davinci · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Tool use
QW
Qwen3 Omni 30B A3B Captioner
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
LL
ehartford_wizardlm-1.0-uncensored-codellama-34b
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
GE
Omega Arsenal 26B A4B Final
Gemma · ReadyArt
Params25.2B
Context256K
Q4_K_M17.7 GB
ReasoningRoleplayTool use
GE
Gemma 4 12B It Qat Q4_0 Uncensored Heretic v3
Gemma · OS-Software
Params11.9B
Context256K
Smallest6.7 GB
Vision
QW
Qwen3.8-27B
Qwen · rax4901
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
GE
Gemma 4 26b A4B Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
RU
Rumeni 26B A4B
Rumeni · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
HA
HarmonicHarlequin v5 20B i1
Harmonicharlequin · mradermacher
Params33.3B
Context4K
Q4_K_M20.1 GB
GGUF
SW
Swish 26B A4B
Swish · ReadyArt
Params25.2B
Context256K
Q4_K_M17.7 GB
Roleplay
QW
Qwen2.5 Coder 14B Instruct
Qwen · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
HU
HunyuanVideo comfy
Hunyuanvideo · Kijai
Params12.8B
Context—
Smallest6.1 GB
GGUF
QW
HIDra-30B-A3B
Qwen · SAPSAN-SKLEP
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
SI
Signal 3.8 27B Terse Coder
Signal · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoning
MI
Devstral Small 2 24B Instruct 2512
Mistral · ggml-org
Params23.6B
Context384K
Smallest25.1 GB
CodingVision
GR
Granite 20b Code Instruct R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
CodingReasoning
GE
Gemma 4 Dark Thoughts 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
RoleplayVision
QW
Qwen3.8-27B
Qwen · loscrossos
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NM DAU NVFP4
Qwen · esatapedico
Params27.3B
Context256K
Smallest15.2 GB
GGUF
FA
Falcon 11B
Falcon · mradermacher
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · bartowski
Params14B
Context4K
Q4_K_M8.6 GB
Coding
GE
Gemma 4 31B StyleTune Heretic Ara
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
EX
EXAONE-4.5-33B
Exaone · LGAI-EXAONE
Params33B
Context256K
Q4_K_M20.0 GB
Vision
MU
Muse Glimmer 30B Heretic
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
Vision
QW
Qwen3.8-27B
Qwen · qtum
Params27B
Context256K
Q4_K_M17.7 GB
Vision
MU
Muse Glimmer 30B Esper4
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
CodingReasoningVision

Other sizes

Keep browsing