Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SY
Synthia v3.0 11B
Synthia · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
Ministral 3 14B Nymphaea RP
Mistral · 0xA50C1A1
Params13.5B
Context—
Smallest0.0 GB
GGUF
MI
Ministral 3 14B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
GGUF
MO
MoNeuTrix MoE 4x7B i1
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GGUF
QW
ElisNovel V3 32B
Qwen · cyanelis
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
HU
Xing4.0 29B A4B APEX I MiniPlus V2.1 Abliterated
Huihui · IsValorum
Params31.2B
Context256K
Smallest13.8 GB
Reasoning
QW
Qwen Qwen3 32B Heretic
Qwen · ThalisAI
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
GO
Goetia 26B A4B v1.7
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
QW
Qwen3 32B VL Instruct Polaris HI16 Heretic Uncensored
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
RoleplayVision
QW
Qwen3.8 27B Cold Fusion GAIN V1.1 NVFP4
Qwen · esatapedico
Params27.3B
Context256K
Smallest14.9 GB
GGUF
CR
Crimson_Dawn v0.2 Base
Crimson · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1 Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningVision
GE
gemma 4 31B it Mystery Fine Tune HERETIC UNCENSORED Thinking Instruct
Gemma · DavidAU
Params30.7B
Context256K
Smallest17.8 GB
CodingReasoningRoleplay
QW
Qwen3-32B-128K
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
PR
prometheus 13B v1.0
Prometheus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
sarvam 30b GGUF IQ2 M IQ1 M
Sarvam · Aaravomega
Params32.2B
Context128K
Smallest7.9 GB
ReasoningTool use
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · robertbschuette
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Code-Gen
Params26.9B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
MI
Minimax h3 Singularity V2 Pruned
Minimax · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
SK
Sky T1 32B Flash
Sky · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
AP
Apriel 1.5 15b Thinker
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
TE
Bonsai 27b Ternary CRACK
Ternary · dealignai
Params27B
Context256K
Smallest8.2 GB
ReasoningTool useVision
QW
Qwen2.5 Wolverine CODER 11B V2 128k Ctx
Qwen · mradermacher
Params10.9B
Context128K
Q4_K_M6.6 GB
Coding
DI
DiscoveryRSI 27B
Discoveryrsi · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningTool useVision
NO
nousresearch_nous-hermes-13b
Nous · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Tool use
QW
Qwopus3.8 27B Flash V2 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
TE
TeaAI Nemo 12B
Teaai · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
QW
Qwen3.8 27B
Qwen · zugquants
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
CO
CodeUp Alpha 13B HF
Codeup · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
WA
wan s2v
Wan · calcuis
Params16.3B
Context—
Q4_K_M13.9 GB
GGUF

Other sizes

Keep browsing