Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
CH
Chandra Ocr 2
Chandra · prithivMLmods
Params4.84B
Context256K
Q4_K_M3.1 GB
MI
MiniCPM OCR 1.0
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 Zero Coder Reasoning V2 0.8B NEO EX
Qwen · DavidAU
Params816M
Context40K
Q4_K_M0.5 GB
NO
nomic-embed-text-v1
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
QW
qwen2-1_5b-instruct
Qwen · Qwen
Params1.54B
Context32K
Q4_K_M1.0 GB
DE
deepseek-ai_deepseek-coder-1.3b-instruct
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
QW
Qwen Image Edit 2509
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
UN
Undi95 Emerhyst 20B
Undi · RichardErkhov
Params920M
Context—
Q4_K_M0.0 GB
JA
Jan-v2-VL-high
Jan · janhq
Params8.2B
Context256K
Q4_K_M5.0 GB
NA
Nanbeige4.2 3B
Nanbeige · gkraker04
Params4.17B
Context256K
Q4_K_M2.6 GB
JA
Jan code 4b
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
HO
K2 Horizon MoVA 36B A4B
Horizon · NANI-Nithin
Params37.4B
Context512K
Q4_K_M22.4 GB
MI
MiniCPM V 4.7 1B DSpark
MiniCPM · openbmb
Params214M
Context256K
Q4_K_M0.1 GB
LI
T lite it 2.1
Lite · t-tech
Params8.2B
Context40K
Q4_K_M5.0 GB
HO
K2 Horizon 0.9B
Horizon · IFM
Params1.08B
Context128K
Q4_K_M0.7 GB
WA
Wan2.1 T2V 1.3B
Wan · samuelchristlie
Params1.42B
Context—
Q4_K_M1.0 GB
QW
Qwen3 Reranker 4B GGUF llama cpp
Qwen · Voodisss
Params4B
Context40K
Q4_K_M2.5 GB
LL
4yo1 llama3 pre1 pre2 ds ins2 lora3
Llama · RichardErkhov
Params200M
Context—
Q4_K_M0.0 GB
AL
Source Hf Aliceai T5 35b A0.6B
Aliceai · ngquocvinh
Params34.6B
Context128K
Q4_K_M21.0 GB
MI
ehartford_dolphin-2.5-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
LF
LFM2.5-24B-A2B
Lfm · NANI-Nithin
Params24B
Context128K
Q4_K_M14.5 GB
OM
OmniCoder 9B
Omnicoder · Tesslate
Params8.95B
Context256K
Q4_K_M5.7 GB
PH
phi 2
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
MI
MiniCPM V 2 6
MiniCPM · openbmb
Params7.61B
Context32K
Q4_K_M4.7 GB
LL
Meta llama_Meta Llama 3 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context8K
Q4_K_M42.5 GB
FL
FLUX.2 klein base 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.4 GB
GR
Granite 4.1 8b
Granite · ibm-granite
Params8.79B
Context128K
Q4_K_M5.3 GB
QW
qwen2-0_5b-instruct
Qwen · Qwen
Params494M
Context32K
Q4_K_M0.4 GB
LT
LTX2.3 10Eros 1.5
Ltx · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
LL
openassistant_codellama-13b-oasst-sft-v10
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB