Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
ME
Melody1437 26B A4B v2.0 APEX
Melody · EmanuelOverride
Params25.2B
Context256K
Q4_K_M13.6 GB
FL
FLUX.1 Fill dev
Flux · gpustack
Params17B
Context—
Smallest10.1 GB
TE
TerraIncognita 24B
Terraincognita · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MU
Muse 12B
Muse · LatitudeGames
Params12.2B
Context128K
Q4_K_M7.5 GB
CH
Chronorctypus Limarobormes 13b
Chronorctypus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen Qwen3.8 27B
Qwen · sigmanih
Params27.3B
Context256K
Smallest10.6 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Suno Song Reasoning Generator Gemma3 12B HF
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Einstein-v4-Qwen-1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
LL
Nous-Hermes-Llama2-13b
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3-Vl-30B-A3B-Thinking-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
SA
Samantha Mythomax l2 13b merge fixed i1
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SK
skywork_skywork-13b-base
Skywork · TheBloke
Params13.9B
Context128K
Q4_K_M8.4 GB
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
PA
Pantheon Rp 1.8 24b Small 3.1
Pantheon · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
TR
Trinity Mini
Trinity · arcee-ai
Params26B
Context128K
Q4_K_M15.9 GB
QW
Qwen3.5 27b Sushi Coder RL
Qwen · bigatuna
Params27B
Context256K
Q4_K_M16.5 GB
IC
iCoder 27B
Icoder · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
GR
Granite 20b Code Base
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
MI
Minimax H3 pruned
Minimax · PurpleBlazey
Params20.1B
Context256K
Smallest6.3 GB
GP
Gpt Neox 20b
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
QW
Qwen3.8 27B Ultra Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
SP
RP Spectrum 24B
Spectrum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.6 27B Uncensored Heretic DSV4Pro GLM52 SFT GPT55 RL Coding VL MTP
Qwen · nerkyor
Params27B
Context256K
Smallest3.2 GB
KR
Krea 2 Turbo
Krea · stduhpf
Params12.9B
Context—
Smallest4.9 GB
QW
Qwen3-16B-A3B
Qwen · unsloth
Params16B
Context40K
Q4_K_M9.8 GB
MI
Dolphin3.0 R1 Mistral 24B
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · RichardErkhov
Params14.8B
Context32K
Q4_K_M9.0 GB
VI
Virtuoso Lite
Virtuoso · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
QW
Qwen3.8-27B
Qwen · SeraphicHero
Params27.3B
Context256K
Q4_K_M16.5 GB