Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
AMD Llama 135m code
Llama · QuantFactory
Params134M
Context2K
Q4_K_M0.1 GB
Coding
LL
lightblue suzume llama 3 8B multilingual
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
FL
Hyper FLUX.1 dev
Flux · martintomov
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
LL
colossal llama 2 7b base
Llama · shaowenchen
Params7.04B
Context4K
Smallest3.0 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
ME
merlyn education safety
Merlyn · TheBloke
Params11.8B
Context2K
Q4_K_M7.6 GB
GGUF
LL
Llama-3-13B-Instruct-v0.1
Llama · QuantFactory
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
IS
Isaak Carter J.O.S.I.E.3 Beta9 7B slerp
Isaak · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PS
Psyfighter 13B
Psyfighter · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
leolm_leo-hessianai-7b-chat-bilingual
Leo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
BU
Buzz 8b Large v0.5
Buzz · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
VE
delcos_velara-11b-v2
Velara · TheBloke
Params11.4B
Context32K
Q4_K_M6.8 GB
GGUF
MI
cloudyu_mixtral_7bx2_moe
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.3 GB
GGUF
MI
MiniCPM V 2 6
MiniCPM · second-state
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingVision
JI
jina embeddings v2 base es
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
MI
mistral nemo wissenschaft 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3 Smaug 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
DU
DuckDB-NSQL-7B-v0.1
Duckdb · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
QW
Qwen2.5 7B
Qwen · QuantFactory
Params7.6B
Context128K
Q4_K_M4.7 GB
GGUF
GR
granite 8b code instruct 4k
Granite · QuantFactory
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
KI
MythoMax Kimiko Mix
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GR
Granite 3.3 2b Base
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
TU
allenai_tulu-2-dpo-13b
Tulu · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
GR
granite 3b code base 2k
Granite · QuantFactory
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
NO
doctor-shotgun_norobara-zloss-8x7b
Norobara · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
SM
SmolLM 360M
SmolLM · QuantFactory
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
LL
Llama 3 8B Lexi Uncensored
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
BI
Bielik 11B v2.2 Instruct
Bielik · QuantFactory
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
QW
xpo-qwen2
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
GE
magnum v3 9b customgemma2
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Other quants

Keep browsing