Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TO
Tongyi DeepResearch 30B A3B
Tongyi · bartowski
Params30.5B
Context128K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.8-27B
Qwen · haybar4k
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
WA
Wan2.1 T2V 14B FusionX VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
HE
Hemmingway 1 Heretic With Mtp Bf16
Hemmingway · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
LL
archangel_sft-kto_llama30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
MI
Ministral 3 14B Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use
QW
Qwen3.8-27B
Qwen · Weirdo333
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
LL
nousresearch_yarn-llama-2-13b-128k
Llama · TheBloke
Params13B
Context128K
Q4_K_M7.9 GB
GGUF
LL
nousresearch_yarn-llama-2-13b-64k
Llama · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
GGUF
PY
ajibawa-2023_python-code-33b
Python · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
Coding
QW
Qwen2.5 14B Instruct 1M
Qwen · bartowski
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
DA
Dans PersonalityEngine V1.3.0 24b
Dans · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
QW
Qwen3.8 27B Uncensored Heretic MTP UD
Qwen · codavidgarcia
Params27.3B
Context256K
Smallest10.9 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct Abliterated
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
QW
Qwen_Qwen3 VL 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
GR
Granite 20b Code Instruct 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
MI
Devstral-Small-2505
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
IN
Ingot II 27B Q2
Ingot · dendriteholdings
Params26.9B
Context256K
Smallest7.2 GB
ReasoningTool use
MI
Magidonia 24B v4.3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
QW
Qwen3.8-27B
Qwen · Aleks199999
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
GE
Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplay
KE
Keye VL 2.0 30B A3B
Keye · Kwai-Keye
Params30.6B
Context256K
Q4_K_M18.6 GB
Vision
GE
Gemma 3 12b It Abliterated v2
Gemma · mlabonne
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen Qwen1.5 MoE A2.7B Chat
Qwen · tensorblock
Params14.3B
Context32K
Smallest5.9 GB
GGUF
QW
Qwen3.8-27B
Qwen · kcarly
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
DA
PocketDoc Dans PersonalityEngine V1.2.0 24b
Dans · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingRoleplay
UN
UnslopNemo 12B v3
Unslopnemo · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Other sizes

Keep browsing