Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Gutensuppe mistral nemo 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LI
LiteLlama 460M 1T
Litellama · tsunemoto
Params462M
Context1K
Q4_K_M0.3 GB
GGUF
NI
L3.1 Niitorm 8B t0.0001
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Vegybin11 Llama 3.1 8B bnb 4bit python
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SA
sabia-7b
Sabia · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SA
saishf Multi Verse RP 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
OP
open cabrita3b
Open · lucianosb
Params3.55B
Context—
Smallest2.1 GB
GGUF
LL
bugdaryan Code Llama 2 13B instruct text2sql
Llama · RichardErkhov
Params3.8B
Context—
Q4_K_M0.0 GB
Coding
GE
WoonaV1.2 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PH
Ph3task2 14B
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
microsoft phi 1 5
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
MY
Mythomist 7b
Mythomist · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 Embedding 4B Bf16
Qwen · Mungert
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingTool use
GL
olmo 3 DISTILL glm 4.7 think
GLM · glogwa68
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
QW
Qwen3-VL-2B-Instruct
Qwen · Mungert
Params1.72B
Context256K
Q4_K_M1.2 GB
Tool useVision
LL
Llama Deepsync 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
CodingTool use
MI
Mistral Nemo Instruct 2407
Mistral · pravdin
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
CH
chinese alpaca 2 13b
Chinese · shaowenchen
Params13.3B
Context4K
Smallest5.6 GB
GGUF
MA
Magro 7b v1.1 imatrix
Magro · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
GLM-4.6V-Flash
GLM · Mungert
Params9.4B
Context128K
Q4_K_M6.6 GB
ReasoningTool useVision
SA
Salamandra 2b Instruct
Salamandra · RichardErkhov
Params2.25B
Context8K
Q4_K_M1.5 GB
GGUF
RW
RWKV v7 0.1B G1
Rwkv · LuRenJiasWorld
Params191M
Context1024K
Q4_K_M0.1 GB
Reasoning
WA
walledguard c
Walledguard · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
OP
OpenCoder 1.5B Base
Opencoder · QuantFactory
Params1.91B
Context4K
Q4_K_M1.4 GB
Coding
CA
CalliopeDS L2 13B
Calliopeds · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AR
arco reasoner v1.3
Arco · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
QW
Virtuoso Small
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
GL
AutoGLM-Phone-9B
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
Vision
MI
eldogbbhed NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
QW
miscii 14b 1028
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
RoleplayTool use

Other quants

Keep browsing