Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
TO
Tongyi DeepResearch 30B A3B
Tongyi · bartowski
Params30.5B
Context128K
Q4_K_M18.6 GB
QW
Qwen3.8-27B
Qwen · haybar4k
Params27.3B
Context256K
Q4_K_M16.6 GB
WA
Wan2.1 T2V 14B FusionX VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
HE
Hemmingway 1 Heretic With Mtp Bf16
Hemmingway · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
LL
archangel_sft-kto_llama30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
MI
Ministral 3 14B Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
QW
Qwen3.8-27B
Qwen · Weirdo333
Params27.3B
Context256K
Q4_K_M16.6 GB
LL
nousresearch_yarn-llama-2-13b-128k
Llama · TheBloke
Params13B
Context128K
Q4_K_M7.9 GB
LL
nousresearch_yarn-llama-2-13b-64k
Llama · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
PY
ajibawa-2023_python-code-33b
Python · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · bartowski
Params14.8B
Context986K
Q4_K_M9.0 GB
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
DA
Dans PersonalityEngine V1.3.0 24b
Dans · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8 27B Uncensored Heretic MTP UD
Qwen · codavidgarcia
Params27.3B
Context256K
Smallest10.9 GB
DE
DeepSeek Coder V2 Lite Instruct Abliterated
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
QW
Qwen_Qwen3 VL 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context256K
Q4_K_M19.8 GB
GR
Granite 20b Code Instruct 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
MI
Devstral-Small-2505
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
IN
Ingot II 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
MI
Magidonia 24B v4.3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8-27B
Qwen · Aleks199999
Params27.3B
Context256K
Q4_K_M16.6 GB
GE
Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
KE
Keye VL 2.0 30B A3B
Keye · Kwai-Keye
Params30.6B
Context256K
Q4_K_M18.6 GB
GE
Gemma 3 12b It Abliterated v2
Gemma · mlabonne
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen Qwen1.5 MoE A2.7B Chat
Qwen · tensorblock
Params14.3B
Context32K
Smallest5.9 GB
QW
Qwen3.8-27B
Qwen · kcarly
Params27.3B
Context256K
Q4_K_M16.6 GB
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
DA
PocketDoc Dans PersonalityEngine V1.2.0 24b
Dans · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
UN
UnslopNemo 12B v3
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB