Q5_K_M GGUF models

5-bit k-quant, medium. A step up in quality from Q4_K_M for a modest size increase. 117156 models have a Q5_K_M file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 26b A4B Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
LE
LensVLM 9B
Lensvlm · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
Vision
RU
Rumeni 26B A4B
Rumeni · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
HA
HarmonicHarlequin v5 20B i1
Harmonicharlequin · mradermacher
Params33.3B
Context4K
Q4_K_M20.1 GB
GGUF
HO
K2-Horizon-3.7B
Horizon · bartowski
Params5.06B
Context512K
Q4_K_M3.3 GB
GGUF
SW
Swish 26B A4B
Swish · ReadyArt
Params25.2B
Context256K
Q4_K_M17.7 GB
Roleplay
QW
Qwen2.5 Coder 14B Instruct
Qwen · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
MI
migtissera_synthia-moe-v3-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
QW
Qwen3 4B 2507 abliterated
Qwen · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
MI
colgrep-agent-2B
MiniCPM · lightonai
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingTool use
QW
HIDra-30B-A3B
Qwen · SAPSAN-SKLEP
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Huihui Qwen3.5 0.8B Abliterated
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
SI
Signal 3.8 27B Terse Coder
Signal · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoning
MI
Ministral 3 8B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Reasoning
GR
Granite 20b Code Instruct R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
CodingReasoning
BA
bagel dpo 34b v0.5 i1
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
CodingRoleplayTool use
GE
Gemma 4 Dark Thoughts 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
RoleplayVision
QW
Qwen3 VL Embedding 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingVision
FA
Falcon 11B
Falcon · mradermacher
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
QW
Qwen3.5 35B A3B ultra uncensored heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
PH
Phi 3 Medium 4k Instruct
Phi · bartowski
Params14B
Context4K
Q4_K_M8.6 GB
Coding
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · AtomicChat
Params7.52B
Context64K
Q4_K_M5.1 GB
ReasoningTool useVision
PY
Pygmalion 2 7B
Pygmalion · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GE
Gemma 3 4B VL It Gemini Pro Heretic Uncensored Thinking
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
QW
Qwen3 VL 4B Instruct Uncensored Abliterated
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
GE
Gemma 4 31B StyleTune Heretic Ara
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
EX
EXAONE-4.5-33B
Exaone · LGAI-EXAONE
Params33B
Context256K
Q4_K_M20.0 GB
Vision
QW
Qwen3.8 9B Distill SLERP F451 Pro Writer Uncensored
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
Roleplay
GR
Granite 4.0 H 350m
Granite · ibm-granite
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Reasoning

Other quants

Keep browsing