Q5_0 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
DE
deepseek-ai_deepseek-coder-1.3b-base
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
WI
wizardlm_wizardcoder-python-13b-v1.0
Wizardcoder · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
LL
LLaMA2 13B Tiefighter
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
FI
Finch 7b
Finch · latestissue
Params7.64B
Context1024K
Smallest3.0 GB
LL
MiniCPM Llama3 V 2 5
Llama · openbmb
Params8.2B
Context8K
Q4_K_M4.9 GB
LL
FILM6912 Meta Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8B
Context—
Q4_K_M0.0 GB
GR
Granite 3.3 8b Instruct
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
LL
Speechless Llama2 Hermes Orca Platypus WizardLM 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
MiniCPM V 4
MiniCPM · openbmb
Params3.6B
Context32K
Q4_K_M2.2 GB
FL
FLUX.1 schnell
Flux · second-state
Params84M
Context—
Smallest0.1 GB
RW
Rwkv 6 World 7b
Rwkv · latestissue
Params7.64B
Context1024K
Smallest3.0 GB
LL
tap-m_luna-ai-llama2-uncensored
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
dolphin 2.8 mistral 7b v02
Mistral · lmstudio-community
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
codellama_codellama-34b-python-hf
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
MY
Mythical Destroyer L2 13B
Mythical · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
HE
0 hero Matter 0.2 7B
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
flux imatrix
Flux · Eviation
Params11.9B
Context—
Q4_K_M6.7 GB
MI
ehartford_dolphin-2.1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llm Jp 4 8b Instruct
Llm · mmnga-o
Params8.59B
Context64K
Q4_K_M5.3 GB
CA
CAT Thinking 8B
Cat · mmnga-o
Params8.19B
Context40K
Q4_K_M5.0 GB
AI
Airoboros L2 7B 2.2
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
YI
Yi 1.5 34B Chat
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
4 alokk llama 3 8b English to Hinglish
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
CH
Chroma1 Flash
Chroma · silveroxides
Params8.9B
Context—
Q4_K_M5.6 GB
QW
GELab-Zero-4B-preview
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.6 GB
ST
sd3.5 medium
Stable · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
LL
Llama2 70B OASST SFT v10
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LT
LTX 2
Ltx · vantagewithai
Params18.9B
Context—
Q4_K_M12.8 GB
GR
Granite 4.0 H Small
Granite · ibm-granite
Params32.2B
Context1024K
Q4_K_M19.5 GB