Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AV
average-dolphin-8x7B
Average · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PH
microsoft Phi 3 mini 128k instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
TO
tokyotech llm Swallow 13b instruct hf
Tokyotech · RichardErkhov
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
PH
Phi 3 mini 4k instruct imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
AU
AutoCoder S 6.7B
Autocoder · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
OpenBioLLM Llama3 70B GGUF smashed
Llama · PrunaAI
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 2 13b Hf
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RW
rwkv 6 finch 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
GGUF
LL
Llama3 8b Cpt Sea Lionv2 Instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
UC
UCLA AGI zephyr 7b sft full SPIN iter3
Ucla · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YO
Youtu-VL-4B-Instruct
Youtu · Mungert
Params4.9B
Context32K
Q4_K_M3.1 GB
Vision
QW
QwQ 32B Preview
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
DE
realtreetune deepseekmath 7b sft GSM8K
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
GR
Granite 34b Code Base 8k
Granite · RichardErkhov
Params33.7B
Context8K
Q4_K_M21.4 GB
Coding
MI
K2S3 Mistral 7b v1.46
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
WA
Wan2.1 Fun 14B Control
Wan · city96
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
GR
granite 4.2 3b
Granite · NANI-Nithin
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
QW
Qwen2.5 0.5B
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
KU
Kunoichi DPO v2 7B
Kunoichi · brittlewis12
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.2 3B Agent007 Coder
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
Coding
QW
Dolphin3.0 Qwen2.5 3B
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use
YI
Yi 1.5 6B Chat
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
QW
Qwen3 coder REAP 25B A3B Rust
Qwen · Em-80
Params25B
Context256K
Q4_K_M15.1 GB
Coding
ST
stabilityai japanese stablelm instruct gamma 7b
Stabilityai · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
HE
HelpingAI 3B coder
Helpingai · QuantFactory
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
OL
Olmo-3-7B-Instruct
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
Tool use
GI
Gille StrangeMerges 50 7B slerp
Gille · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NA
Nanbeige4.1-3B
Nanbeige · Mungert
Params3.93B
Context256K
Q4_K_M2.6 GB
GGUF
GE
Gemma 3 1b It
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LL
Emma 500 Llama2 7b
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Other quants

Keep browsing