Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
PE
Peach 9B 8k Roleplay
Peach · QuantFactory
Params8.8B
Context16K
Q4_K_M5.3 GB
WH
whisper medium
Whisper · oxide-lab
Params764M
Context—
Smallest0.3 GB
LL
LongWriter Llama3.1 8b
Llama · duyntnet
Params8B
Context128K
Q4_K_M4.9 GB
LL
llama 3 sqlcoder 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
DE
DeepScaleR 1.5B Preview
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
emma 500 llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.2 1B
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
CH
Chunky-Lemon-Cookie-11B
Chunky · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Ministral 3b instruct
Mistral · QuantFactory
Params3.32B
Context128K
Q4_K_M2.0 GB
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
DA
arco reflection v4
Danube · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
QW
Josiefied Qwen2.5 7B Instruct Abliterated
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
SZ
szymonrucinski Curie 7B v1
Szymonrucinski · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
reader lm 1.5b
Reader · QuantFactory
Params1.78B
Context250K
Q4_K_M1.1 GB
EV
Evolutionstory
Evolutionstory · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
FLOR 6.3B Instructed
Flor · xaviviro
Params6.45B
Context4K
Q4_K_M4.1 GB
TI
Tinystories Lay8 Hs512 Hd8 33M
Tinystories · RichardErkhov
Params165M
Context512
Q4_K_M0.1 GB
LL
Llama-3-8B-grammar-correction
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LU
L3 bluuwhale SAO MIX 8B V1 fp32 merge calc
Lunaris · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
PH
TroyDoesAI Phi 3 Context Obedient RAG GGUF smashed
Phi · PrunaAI
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
Mistral 7B Instruct RDPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
ORLM LLaMA 3 8B
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
MI
DonutHole 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
TI
minecraft
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 7B Instruct Abliterated
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
LT
ltxv0.9.7
Ltx · calcuis
Params13B
Context—
Q4_K_M9.1 GB
QW
Qwen3 Reranker 4B
Qwen · QuantFactory
Params4.4B
Context40K
Q4_K_M2.7 GB
YI
dolphin 2.9.1 yi 1.5 9b
Yi · QuantFactory
Params8.83B
Context12K
Q4_K_M5.3 GB
PA
Pantheon Rp 1.8 24b Small 3.1
Pantheon · BasedAGI
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
K2S3 Mistral 7b v1.4
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB