Q5_K_M GGUF models

5-bit k-quant, medium. A step up in quality from Q4_K_M for a modest size increase. 117156 models have a Q5_K_M file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 122B A10B Abliterix
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
QW
Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3-30B-A3B-128K
Qwen · unsloth
Params30.5B
Context128K
Q4_K_M18.6 GB
GGUF
CH
AA Chameleon 7b Plus
Chameleon · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
QW
Qwen3 4b Z Image Engineer V4
Qwen · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
GE
Gemma 3n E2B It
Gemma · bartowski
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
LL
calme 2.2 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
MI
Minimax-M2.5
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
SH
Shadow-Siren-14B-v2-Pruned
Shadow · mradermacher
Params13.8B
Context256K
Q4_K_M9.2 GB
Roleplay
AI
jondurbin_airoboros-c34b-3.1.2
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
IN
InternVL3_5 38B
Internvl · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
Vision
PH
Phi 3 Medium 4k Instruct
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
Coding
IN
InternVL3_5 38B
Internvl · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
CodingVision
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
LF
LFM2.5 1.2B JP 202606
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · nyan-ame
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
DE
Deepseeker Kunou Qwen2.5 14b i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
GE
Genz 70b
Genz · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwopus3.5 27B v3 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
ZW
ZwZ2 4B
Zwz · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
MI
kolibri-vikhr-mistral-0427
Mistral · Vikhrmodels
Params7.6B
Context32K
Q4_K_M4.6 GB
GGUF
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB
Vision
OR
ddh0_orcamaidxl-17b-32k
Orcamaidxl · TheBloke
Params17.5B
Context32K
Q4_K_M10.5 GB
GGUF
LT
ltxv 13b 0.9.7 dev
Ltx · ThePun1sher
Params13B
Context—
Q4_K_M8.8 GB
GGUF
MI
mlabonne_neuralhermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
MiniCPM V 4.7 35B A3B
MiniCPM · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
Vision
TR
Trida2.0 4B
Trida · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use

Other quants

Keep browsing