Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Magistral-Small-2506
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
ReasoningVision
PY
Pythia 12b
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
GGUF
GO
Goetia 24B v1.4 Heretic
Goetia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
MI
Mistral Small Drummer 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
LL
Llama 2 13B Chat Dutch
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MA
magnum v4 27b
Magnum · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
SK
SkyReels V2 I2V 14B 720P
Skyreels · ThePun1sher
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
SN
Snowpiercer 15B v4
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
CO
COTHuginn 4.5 19B
Cothuginn · TheBloke
Params19.4B
Context4K
Q4_K_M11.7 GB
GGUF
D3
d3 i1
mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
FR
Free_Sydney_13b_HF
Free · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
Gemma 3 12b It Qat
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen2.5 Coder 14B Instruct
Qwen · gaianet
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
WI
ehartford_wizardlm-30b-uncensored
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · NANI-Nithin
Params32.9B
Context1024K
Q4_K_M25.4 GB
GGUF
CY
Cydonia 24B v4.3 Heretic
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
NA
Nanbeige 4.3 33B Heretic
Nanbeige · Luni
Params33.1B
Context512K
Smallest7.7 GB
ReasoningTool use
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
VI
vicuna 13B v1.5
Vicuna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
SARC Taigi LLM 12b
Gemma · Speech-AI-Research-Center
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
FU
Fugaku-LLM-13B-instruct
Fugaku · mmnga
Params13.4B
Context2K
Q4_K_M9.6 GB
GGUF
SK
Sky T1 32B Preview
Sky · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
CA
camel-ai_camel-13b-role-playing-data
Camel · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Roleplay
GE
Gemma 4 12B It
Gemma · prithivMLmods
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
PH
Phi 4 Reasoning plus_Nemotron Reasoning 0803_SFT GRPO
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
WI
Wizard Vicuna 13B Uncensored
Wizard · second-state
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
QW
Qwen Image Edit Rapid AIO NSFW v23 NVFP4
Qwen · FreedomAISVR
Params20.4B
Context32K
Smallest4.1 GB
GGUF
LL
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
GO
Goetia 26B A4B v1.3 Absolute Heretic ARA
Goetia · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay

Other sizes

Keep browsing