Q5_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15099 models have a Q5_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Tetra04
Params34.7B
Context256K
Q4_K_M21.2 GB
VI
Vinallama 7b Chat
Vinallama · RichardErkhov
Params6.86B
Context4K
Q4_K_M4.2 GB
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
NX
Nxcode-CQ-7B-orpo
Nxcode · Monor
Params7.25B
Context64K
Q4_K_M4.7 GB
LL
MrRobotoAI llama3 8B Special Dark v3.1.2c
Llama · RichardErkhov
Params8B
Context1024K
Q4_K_M4.9 GB
GR
granite-3b-code-instruct
Granite · SanctumAI
Params3.48B
Context2K
Q4_K_M2.1 GB
QW
Qwen3.8 27B
Qwen · eaddario
Params27.3B
Context—
Smallest0.0 GB
MA
Magnum Instruct DPO
Magnum · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
PH
Phi 3 mini 128k instruct IMat
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
LL
Llama 3 8B Instruct
Llama · hermes42
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · Zyszztggd
Params8.19B
Context—
Smallest3.3 GB
LL
h2oai h2ogpt 16k codellama 13b instruct
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M1.7 GB
QW
Karlsen Chat 27B abliterated
Qwen · karlsencoin
Params27.3B
Context256K
Q4_K_M16.6 GB
ST
starcoder2-15b
StarCoder · RichardErkhov
Params16B
Context16K
Q4_K_M9.9 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · hardcoremoore
Params1.86B
Context—
Smallest0.9 GB
JS
jsfs11 MixtureofMerges MoE 2x7b v7
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
LL
OpenMath2 Llama3.1 8B
Llama · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
LL
ZhangShenao SELM Llama 3 8B Instruct iter 3
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
QR
Qra 7b Dolly Instruction 0.1
Qra · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · LxBarn
Params1.86B
Context256K
Smallest0.9 GB
ME
Meltemi 7B Instruct v1.5
Meltemi · RichardErkhov
Params7.48B
Context32K
Q4_K_M4.5 GB
MI
chihoonlee10 T3Q EN DPO Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Falcon H1 3B Instruct
Falcon · tiiuae
Params3.15B
Context128K
Q4_K_M1.9 GB
CO
Yi Coder 9B Chat
Coder · legraphista
Params8.83B
Context128K
Smallest2.0 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
RE
reader lm 1.5b IMat
Reader · legraphista
Params1.54B
Context250K
Smallest0.4 GB
NE
neo_7b_sft_v0.1
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
IC
icefog72 IceLemonTeaRP 32k 7b
Icefog · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB