Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 12b It
Gemma · DavidAU
Params11.8B
Context128K
Q4_K_M8.5 GB
GGUF
ST
Stellar Witch 12B Heretic
Stellar · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
GE
Gemma 4 26B A4B It Qat
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3 Coder 30B A3B Instruct
Qwen · giladgd
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
LT
LTX 2
Ltx · QuantStack
Params18.9B
Context—
Q4_K_M13.4 GB
GGUF
CA
Carbon X
Carbon · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
MI
openaccess-ai-collective_minotaur-13b-fixed
Minotaur · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
ST
Dolphincoder Starcoder2 15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
CodingTool use
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
TE
Tess 10.7B v1.5b
Tess · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MX
MXLewdMini L2 13B
Mxlewdmini · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mixtral 8x7B v0.1 instruct l2 norm post SFT pruned 3 experts
Mistral · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
GU
timdettmers_guanaco-33b-merged
Guanaco · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
PS
Psyonic Cetacean Ultra Quality 20b
Psyonic · DavidAU
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
IN
InnoSpark3.1 27B 1008
Innospark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.8 27B thinkingcap abliterated mtp
Qwen · hotdogs
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
CO
ContextPilot 14B
Contextpilot · bartowski
Params14.8B
Context40K
Q4_K_M9.3 GB
Tool use
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
CY
Cydonia 24B v3
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
Kev 27b
Qwen · kdercksen
Params25.6B
Context256K
Q4_K_M15.8 GB
GGUF
QW
Qwen3 The Xiaolong Omega Directive 22B Uncensored Abliterated
Qwen · mradermacher
Params22B
Context40K
Q4_K_M13.3 GB
Roleplay
FI
adaptllm_finance-llm-13b
Finance · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
GL
Glimmer 31B v1.0
Glistening · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
CY
Cydonia 24B v4.1
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
PI
PixelWave FLUX.1 dev 03
Pixelwave · mikeyandfriends
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
CH
austism_chronos-hermes-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Tool use
CL
Claude2 Alpaca 13B
Claude · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · fribourgquants
Params26.9B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Swift 1.5 Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
GE
Gemma 4 Garnet 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF

Other sizes

Keep browsing