Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
ZE
zephyr 7b alpha
Zephyr · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM V 4.7 1B
MiniCPM · theokiGuyOKI
Params1.01B
Context256K
Q4_K_M0.7 GB
GE
Abliterated
Gemma · anlord
Params4.63B
Context128K
Q4_K_M3.4 GB
LF
LFM2.5 8B A1B
Lfm · RemySkye
Params8.47B
Context125K
Q4_K_M5.2 GB
GE
boto-9B-GGUF
Gemma · lucianosb
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Mistral 22B v0.2 GGUF smashed
Mistral · PrunaAI
Params22.2B
Context64K
Q4_K_M13.3 GB
WA
wavecoder ultra 6.7b
Wavecoder · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
EV
totally-not-an-llm_everythinglm-13b-16k
Everythinglm · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
LL
Llama 3 Swallow 70B v0.1
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
SP
SparseLlama 3 8B Pruned_50.2Of4
Sparsellama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · QuantFactory
Params6.9B
Context4K
Q4_K_M4.2 GB
GE
Gemma 2 9b It WPO HB
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
lb reranker 0.5B v1.0
Qwen · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
PO
Poro 34B
Poro · RichardErkhov
Params34B
Context7K
Q4_K_M22.4 GB
QW
Qwen2 VL 2B Instruct
Qwen · turingevo
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
mini magnum 12b v1.1
Mini · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
BH
BharatGPT 3B Indic
Bharatgpt · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
TW
TwinLlama 3.1 8B
Twinllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Suri Qwen 3.5 9B Uncensored
Qwen · SpaceTimee
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
LLaMA 2 7B 32K Instruct
Llama · rozek
Params6.74B
Context32K
Q4_K_M4.1 GB
QW
Qwen2.5-Omni-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
PH
Phi 3.5 Mini Instruct
Phi · SanctumAI
Params3.82B
Context128K
Q4_K_M2.4 GB
ME
MetaMath Bagel DPO 34B
Metamath · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen2.5 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 Math 1.5B
Qwen · QuantFactory
Params1.54B
Context4K
Q4_K_M1.0 GB
SU
Supertron 2.1 8B A1B
Supertron · Surpem
Params8.47B
Context125K
Q4_K_M5.2 GB
LL
Llama3 ChatQA 2 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · second-state
Params1.54B
Context4K
Q4_K_M1.0 GB
QW
Qwen3-1.7B-abliterated
Qwen · Mungert
Params1.72B
Context40K
Q4_K_M1.1 GB
PH
Phi 3 medium 4k instruct imatrix
Phi · duyntnet
Params14B
Context4K
Q4_K_M8.6 GB