Q5_0 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 21732 models have a Q5_0 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SU
sustech_sus-chat-34b
Sus · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF
QW
Dolphin3.0 Qwen2.5 3B
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use
YI
Yi 1.5 6B Chat
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
QW
Qwen3 coder REAP 25B A3B Rust
Qwen · Em-80
Params25B
Context256K
Q4_K_M15.1 GB
Coding
BG
bge-small-en-v1.5
BGE · ChristianAzinn
Params33M
Context512
Q4_K_M0.0 GB
Embedding
ST
stabilityai japanese stablelm instruct gamma 7b
Stabilityai · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
TO
tokyotech llm Swallow 7b instruct v0.1
Tokyotech · mmnga
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
HE
HelpingAI 3B coder
Helpingai · QuantFactory
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
OL
Olmo-3-7B-Instruct
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
Tool use
ME
steve-cse_mellogpt
Mellogpt · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
stable-code-instruct-3b
Stable · lmstudio-community
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
DE
triadparty_deepmoney-34b-200k-base
Deepmoney · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
GI
Gille StrangeMerges 50 7B slerp
Gille · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NA
Nanbeige4.1-3B
Nanbeige · Mungert
Params3.93B
Context256K
Q4_K_M2.6 GB
GGUF
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
HA
Harmonic Hermes 9B
Harmonic · DJLougen
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
CodeQwen1.5 7B Chat
Qwen · Qwen
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
LL
Upstage Llama 2 70B instruct v2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
alfredplpl Llama 3 8B Instruct Ja
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
PL
Plamo 2 Translate
Plamo · mmnga
Params9.53B
Context10240K
Smallest4.6 GB
GGUF
NO
argilla_notux-8x7b-v1
Notux · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
GE
Gemma 3 1b It
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LL
Emma 500 Llama2 7b
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen3 Reranker 8B
Qwen · QuantFactory
Params8.2B
Context40K
Q4_K_M5.0 GB
Embedding
LO
louisbrulenaudet Maxine 7B 0401 stock
Louisbrulenaudet · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
LMCocktail phi 2 v1
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
GE
gemma-4-31B-it
Gemma · Mungert
Params30.7B
Context256K
Q4_K_M19.3 GB
Vision
DE
openbuddy deepseek 67b v15 base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
HA
potatooff_hamster-0.1
Hamster · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DR
DreadPoor Harpy 7B Model Stock
Dreadpoor · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing