Q5_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15099 models have a Q5_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
smol_llama-220M-open_instruct
Llama · RichardErkhov
Params218M
Context2K
Q4_K_M0.1 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · quantized4all
Params8.19B
Context128K
Q4_K_M5.0 GB
YI
Yi 34B 200K DARE Merge v5
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
Suzume Llama 3 8B Multilingual
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · adsdaw
Params34.7B
Context256K
Q4_K_M21.2 GB
SO
I SOLAR 10.7B Sft v1.0
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
HA
habanoz tinyllama oasst1 top1 instruct full lr1 5 v0.1
Habanoz · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama 3.2 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
MinaMila GermanCredit Ext Mitig CFA llama 3 InstBase ImpFeat 20ep withsex
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 1.5B Instruct MLX
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
grimjim Llama 3 Oasis v1 OAS 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
BL
Bloomz 3b
Bloomz · RichardErkhov
Params3.64B
Context2K
Q4_K_M2.4 GB
YU
YuE2 3B
Yue · LattifAI
Params3.63B
Context24K
Smallest0.1 GB
QW
Qwen3.6 35B A3B MagicQuant
Qwen · magiccodingman
Params34.7B
Context256K
Q4_K_M22.3 GB
QW
Qwen2 0.5B Instruct
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GW
Gweizheng Marcoro14 7B dare
Gweizheng · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GH
Ghost 8b Beta 1608
Ghost · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 7b Hf
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GE
google-gemma-2b-it-dequantized
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
mlfoundations dev hp ablations mistral scheduler linear warmup0.10 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Balaaditya GPT2 Finetuned Emotion Classification
Balaaditya · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
QW
Qwen3.8 27B Heretic Ara
Qwen · filvyb
Params26.9B
Context256K
Smallest10.7 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackoverflow 25000tasks 75p
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
Fixed_Sana
Fixed · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
dat lequoc fast apply 16bit v0.v15 Qwen2.5 Coder 1.5B
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
ST
StableCode 3B
Stablecode · RichardErkhov
Params2.77B
Context4K
Q4_K_M1.8 GB
AU
automerger ShadowYamshadow 7B
Automerger · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Falcon H1 Tiny R 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB