Q5_K_M GGUF models

5-bit k-quant, medium. A step up in quality from Q4_K_M for a modest size increase. 117156 models have a Q5_K_M file. Sizes run from 1M to 1570B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
PreciseCoder 9B
Precisecoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Coding
LL
DaringFortitude
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CY
Cyberdonia 24B v8
Cyberdonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
GE
gemma-2-9b-it
Gemma · lmstudio-community
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
HU
HunyuanVideo 1.5 T2V 480p
Hunyuanvideo · jayn7
Params8.33B
Context—
Q4_K_M5.1 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
Coding
WI
Wicked Stuff 26B A4B v2.0 Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
HI
HiDream I1 Full
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
GGUF
QW
Qwen3.6 27B Architect Polaris2 Fable B F451 heretic
Qwen · mcgonzo
Params27B
Context256K
Q4_K_M16.5 GB
Vision
GR
grok oss Apollyon 8B
Grok · c4tdr0ut
Params8B
Context128K
Smallest5.7 GB
GGUF
QW
Huihui Qwen3 Next 80B A3B Thinking Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
Reasoning
LY
Lythri-7B-A4B
Lythri · Lythri
Params7.46B
Context128K
Smallest5.7 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LL
Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RW
Rwkv 6 World 7b
Rwkv · bartowski
Params7.64B
Context1024K
Q4_K_M4.8 GB
GGUF
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · DuoNeural
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingTool use
FI
FinanceGemma E4B
Financegemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
VE
Veloxy Flash 15B
Veloxy · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
QW
Qwen3.6 27B Uncensored Heretic v2 Native MTP Preserved
Qwen · llmfan46
Params27.3B
Context256K
Q4_K_M17.2 GB
Vision
LL
Meta Llama 3 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
FA
Falcon H1R 7B
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · bartowski
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
LL
llm4decompile 9b v2
Llm · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · mistralai
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
QW
Qwen3.6 27B
Qwen · AtomicChat
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
G9
G9v3 3B
bartowski
Params3B
Context128K
Q4_K_M1.9 GB
Tool use
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
SM
Smollm3-3B-128K
SmolLM · unsloth
Params3.08B
Context128K
Q4_K_M1.9 GB
GGUF
GE
Huihui Gemma 4 E4B It Abliterated
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
FL
flux2 klein
Flux · ChrisColeTech
Params9.08B
Context40K
Q4_K_M5.0 GB
Vision

Other quants

Keep browsing