Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
CodeLlama 13b Python Hf
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Coding
ST
SD3.5 Large GGUF mixed sdcpp
Stable · stduhpf
Params8.23B
Context—
Smallest4.7 GB
GGUF
MI
mistral doryV2 12b
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama DNA 1.0 8B Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
WA
wamegabe tinyllama wame 4bit curi
Wamegabe · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
FL
flux hyp8
Flux · mhnakif
Params11.9B
Context—
Smallest6.8 GB
GGUF
LL
Llama-3-8b-64k-PoSE
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
OpenCodeReasoning Nemotron 1.1 7B imatrix
Nemotron · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
DA
Darkknight535 OpenCrystal 12B L3
Darkknight · RichardErkhov
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
QW
Qwen3-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.2 GB
ReasoningTool use
LU
XL LuaCopilot 1.7B FFT
Luacopilot · nwdxlgzs
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
LL
CodeLlama 7b Instruct Hf
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ML
mlfoundations dev oh teknium scaling down random 0.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
antonytm codellama 34b bnb 4bit sitecore so
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
HE
Heejindo rationale model e3 save5000 f4
Heejindo · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · alex77coder
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
RE
Refact-1_6B-fim
Refact · Mungert
Params1.59B
Context4K
Q4_K_M1.0 GB
Coding
LL
vidhirambhia test llama math coder
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
VI
Captain Eris Violet V0.420 12B
Violet · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
robinsmits Qwen1.5 7B Dutch Chat
Qwen · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
QW
OpenThinker3 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
AZ
Azazelle Half NSFW Noromaid 7b
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
ndebuhr Mistral 7B Technical Tutorial Summarization QLoRA
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Papy_1_Llama 3.1 8B Instruct_date
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · duyntnet
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3-30B-A1.5B-High-Speed
Qwen · Mungert
Params30.5B
Context40K
Q4_K_M18.9 GB
ReasoningTool use
NE
Nemotron-Cascade-2-30B-A3B
Nemotron · Mungert
Params31.6B
Context1024K
Q4_K_M23.9 GB
ReasoningTool use
MI
dolphin-2.1-mistral-7b-snr-math-laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
DI
distill_gpt2_story_generator
Distill · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF

Other quants

Keep browsing