Q5_K GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15099 models have a Q5_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B MagicQuant
Qwen · magiccodingman
Params27.3B
Context256K
Q4_K_M17.6 GB
Vision
SW
Swallow-MS-7b-v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Jattt6789
Params1.86B
Context256K
Smallest0.9 GB
GGUF
PH
phi3-4x4b-v1
Phi · RichardErkhov
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · RichardErkhov
Params1.78B
Context32K
Q4_K_M1.1 GB
Coding
AL
Alphacode AI AlphaMist7B slr v3
Alphacode · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 TTS
Qwen · Solidaxel
Params142M
Context32K
Smallest0.2 GB
GGUF
QW
Qwen3.8-27B
Qwen · LeeMantras
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
IN
Intel neural chat 7b v3 1
Intel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TA
TableLLM 7b
Tablellm · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Reasoning
LL
Llama 3 Meerkat 70b v1.0
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 Peach Instruct 4x8B MoE
Llama · RDson
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
GGUF
NE
neo 7b IMat
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
GGUF
EV
L3 Evil Stheno v3.2 8B
Evil · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
GE
lemon mint gemma ko 7b instruct v0.71
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
wassimm Llama 3.1 8B psycology w 6k data
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3-TTS-12Hz-1.7B-Base
Qwen · FILM6912
Params3.1B
Context—
Smallest1.7 GB
GGUF
MI
jisukim8873 mistral 7B alpaca 1 epoch
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · aoiandroid
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
TH
THaLLE 0.1 7B Fa
Thalle · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
llama-3-typhoon-v1.5-8b-instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
IN
Internlm2_5 20b Chat
InternLM · legraphista
Params19.9B
Context32K
Smallest4.5 GB
GGUF
MA
macadeliccc magistrate 3.2 3b it
Macadeliccc · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
K2
K2 IMat
legraphista
Params65.3B
Context2K
Smallest14.2 GB
GGUF
LL
Llama 3 Tulu 2 70b
Llama · RichardErkhov
Params70.6B
Context2K
Q4_K_M42.5 GB
GGUF
AN
Anima2
Anima · JusteLeo
Params2.09B
Context—
Q4_K_M1.2 GB
GGUF
LL
Llama 2 7b Pruned50 Retrained
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Other quants

Keep browsing