Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
GE
Gemma 3 12b It
Gemma · DavidAU
Params11.8B
Context128K
Q4_K_M8.5 GB
ST
Stellar Witch 12B Heretic
Stellar · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GE
Gemma 4 26B A4B It Qat
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · giladgd
Params30.5B
Context256K
Q4_K_M18.6 GB
LT
LTX 2
Ltx · QuantStack
Params18.9B
Context—
Q4_K_M13.4 GB
CA
Carbon X
Carbon · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
MI
openaccess-ai-collective_minotaur-13b-fixed
Minotaur · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
ST
Dolphincoder Starcoder2 15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
TE
Tess 10.7B v1.5b
Tess · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
MX
MXLewdMini L2 13B
Mxlewdmini · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
Mixtral 8x7B v0.1 instruct l2 norm post SFT pruned 3 experts
Mistral · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
GU
timdettmers_guanaco-33b-merged
Guanaco · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
PS
Psyonic Cetacean Ultra Quality 20b
Psyonic · DavidAU
Params20B
Context4K
Q4_K_M12.0 GB
IN
InnoSpark3.1 27B 1008
Innospark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B thinkingcap abliterated mtp
Qwen · hotdogs
Params27.3B
Context256K
Q4_K_M16.8 GB
CO
ContextPilot 14B
Contextpilot · bartowski
Params14.8B
Context40K
Q4_K_M9.3 GB
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CY
Cydonia 24B v3
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Kev 27b
Qwen · kdercksen
Params25.6B
Context256K
Q4_K_M15.8 GB
QW
Qwen3 The Xiaolong Omega Directive 22B Uncensored Abliterated
Qwen · mradermacher
Params22B
Context40K
Q4_K_M13.3 GB
FI
adaptllm_finance-llm-13b
Finance · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GL
Glimmer 31B v1.0
Glistening · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CY
Cydonia 24B v4.1
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
PI
PixelWave FLUX.1 dev 03
Pixelwave · mikeyandfriends
Params11.9B
Context—
Q4_K_M6.9 GB
CH
austism_chronos-hermes-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
CL
Claude2 Alpaca 13B
Claude · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · fribourgquants
Params26.9B
Context256K
Q4_K_M18.0 GB
QW
Swift 1.5 Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 Garnet 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB