Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
MI
Magistral-Small-2506
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
PY
Pythia 12b
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
GO
Goetia 24B v1.4 Heretic
Goetia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small Drummer 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
LL
Llama 2 13B Chat Dutch
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
Mistral Nemo Instruct 2407
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
magnum v4 27b
Magnum · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
SK
SkyReels V2 I2V 14B 720P
Skyreels · ThePun1sher
Params16.4B
Context—
Q4_K_M10.9 GB
SN
Snowpiercer 15B v4
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
CO
COTHuginn 4.5 19B
Cothuginn · TheBloke
Params19.4B
Context4K
Q4_K_M11.7 GB
D3
d3 i1
mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
FR
Free_Sydney_13b_HF
Free · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GE
Gemma 3 12b It Qat
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · gaianet
Params14.8B
Context32K
Q4_K_M9.0 GB
WI
ehartford_wizardlm-30b-uncensored
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · NANI-Nithin
Params32.9B
Context1024K
Q4_K_M25.4 GB
CY
Cydonia 24B v4.3 Heretic
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
NA
Nanbeige 4.3 33B Heretic
Nanbeige · Luni
Params33.1B
Context512K
Smallest7.7 GB
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
VI
vicuna 13B v1.5
Vicuna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GE
SARC Taigi LLM 12b
Gemma · Speech-AI-Research-Center
Params11.8B
Context128K
Q4_K_M7.3 GB
FU
Fugaku-LLM-13B-instruct
Fugaku · mmnga
Params13.4B
Context2K
Q4_K_M9.6 GB
SK
Sky T1 32B Preview
Sky · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
CA
camel-ai_camel-13b-role-playing-data
Camel · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GE
Gemma 4 12B It
Gemma · prithivMLmods
Params11.9B
Context256K
Q4_K_M7.4 GB
PH
Phi 4 Reasoning plus_Nemotron Reasoning 0803_SFT GRPO
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
WI
Wizard Vicuna 13B Uncensored
Wizard · second-state
Params13B
Context2K
Q4_K_M7.9 GB
QW
Qwen Image Edit Rapid AIO NSFW v23 NVFP4
Qwen · FreedomAISVR
Params20.4B
Context32K
Smallest4.1 GB
LL
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GO
Goetia 26B A4B v1.3 Absolute Heretic ARA
Goetia · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB