Q5_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15099 models have a Q5_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
QW
Qwen3.8-27B
Qwen · haybar4k
Params27.3B
Context256K
Q4_K_M16.6 GB
FA
90m Instruct
Falcon · tiiuae
Params91M
Context256K
Q4_K_M0.1 GB
QW
Qwen3.8-27B
Qwen · Weirdo333
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8-27B
Qwen · Aleks199999
Params27.3B
Context256K
Q4_K_M16.6 GB
WH
whisper tiny
Whisper · oxide-lab
Params38M
Context—
Smallest0.0 GB
QW
Qwen3.8-27B
Qwen · kcarly
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8-27B
Qwen · Fhjdjdbxhshsh
Params27.3B
Context256K
Q4_K_M16.6 GB
LL
Llama3-Chinese-8B-Instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
XL
xLAM 8x7b R
Xlam · legraphista
Params46.7B
Context32K
Smallest9.8 GB
LL
Hermes-2-Theta-Llama-3-8B
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
QW
Qwen3.8-27B
Qwen · igroc656
Params27.3B
Context256K
Q4_K_M16.6 GB
DA
datagemma rig 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
QW
Qwen3.8-27B
Qwen · xrachelburns
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8-27B
Qwen · Shishkipiski
Params27.3B
Context256K
Q4_K_M16.6 GB
YI
01 ai Yi 6B 200K
Yi · RichardErkhov
Params6.06B
Context195K
Q4_K_M3.7 GB
QW
Qwen3.8-27B
Qwen · yachiyo8080
Params27.3B
Context256K
Q4_K_M16.6 GB
LL
Llama 3.2 3B Instruct
Llama · legraphista
Params3.21B
Context128K
Smallest0.9 GB
OR
Ornith 1.5 122B DFlash2
Ornith · kaivoss
Params930M
Context256K
Q4_K_M0.6 GB
QW
Qwenmodel1st
Qwen · atypical-chai
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8-27B
Qwen · Kaktus4048
Params27.3B
Context256K
Q4_K_M16.6 GB
XL
xLAM 8x22b R
Xlam · legraphista
Params141B
Context64K
Smallest29.7 GB
K2
K2-ckpt_360
legraphista
Params65B
Context2K
Smallest14.2 GB
QW
Qwen3.8-27B
Qwen · rax4901
Params27.3B
Context256K
Q4_K_M16.6 GB
CO
C4Ai Command R Plus 08 2024
Command R · legraphista
Params104B
Context128K
Smallest23.2 GB
GR
Granite 20b Code Instruct R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
QW
Qwen3.8-27B
Qwen · loscrossos
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen2-0.5B
Qwen · legraphista
Params494M
Context128K
Smallest0.3 GB
QW
qwen3 tts 12hz 1.7b ru stress
Qwen · sknyazev
Params142M
Context32K
Smallest0.2 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · kamjin
Params7.5B
Context128K
Q4_K_M5.3 GB
QW
Qwen3.8-27B
Qwen · LxBarn
Params27.3B
Context256K
Q4_K_M16.6 GB