Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
Melody1437 26B A4B v2.0 APEX
Melody · EmanuelOverride
Params25.2B
Context256K
Q4_K_M13.6 GB
Roleplay
FL
FLUX.1 Fill dev
Flux · gpustack
Params17B
Context—
Smallest10.1 GB
GGUF
TE
TerraIncognita 24B
Terraincognita · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MU
Muse 12B
Muse · LatitudeGames
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
CH
Chronorctypus Limarobormes 13b
Chronorctypus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen Qwen3.8 27B
Qwen · sigmanih
Params27.3B
Context256K
Smallest10.6 GB
ReasoningTool use
QW
Qwen2.5 Coder 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
GE
Suno Song Reasoning Generator Gemma3 12B HF
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
QW
Einstein-v4-Qwen-1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
CodingTool use
LL
Nous-Hermes-Llama2-13b
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
QW
Qwen3-Vl-30B-A3B-Thinking-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
ReasoningVision
SA
Samantha Mythomax l2 13b merge fixed i1
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SK
skywork_skywork-13b-base
Skywork · TheBloke
Params13.9B
Context128K
Q4_K_M8.4 GB
GGUF
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
PA
Pantheon Rp 1.8 24b Small 3.1
Pantheon · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
TR
Trinity Mini
Trinity · arcee-ai
Params26B
Context128K
Q4_K_M15.9 GB
GGUF
QW
Qwen3.5 27b Sushi Coder RL
Qwen · bigatuna
Params27B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
IC
iCoder 27B
Icoder · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
GR
Granite 20b Code Base
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
Coding
MI
Minimax H3 pruned
Minimax · PurpleBlazey
Params20.1B
Context256K
Smallest6.3 GB
GGUF
GP
Gpt Neox 20b
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
GGUF
QW
Qwen3.8 27B Ultra Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
SP
RP Spectrum 24B
Spectrum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
QW
Qwen3.6 27B Uncensored Heretic DSV4Pro GLM52 SFT GPT55 RL Coding VL MTP
Qwen · nerkyor
Params27B
Context256K
Smallest3.2 GB
ReasoningVision
KR
Krea 2 Turbo
Krea · stduhpf
Params12.9B
Context—
Smallest4.9 GB
GGUF
QW
Qwen3-16B-A3B
Qwen · unsloth
Params16B
Context40K
Q4_K_M9.8 GB
GGUF
MI
Dolphin3.0 R1 Mistral 24B
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
Reasoning
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · RichardErkhov
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
VI
Virtuoso Lite
Virtuoso · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
QW
Qwen3.8-27B
Qwen · SeraphicHero
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision

Other sizes

Keep browsing