Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
OL
OLMo-1.7-7B-hf
OLMo · duyntnet
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
VI
Vistral-7B-Chat
Vistral · duyntnet
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · AaryanK
Params119B
Context1024K
Q4_K_M72.2 GB
ReasoningTool useVision
LL
Llama 3 8B Magpie Pro SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
VanillaKD Pretrain Qwen 200M
Qwen · RichardErkhov
Params203M
Context32K
Q4_K_M0.2 GB
GGUF
GE
Gemma 2 Ataraxy v2 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
IN
MD Judge V0_2 Internlm2_7B
InternLM · RichardErkhov
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Llama 3 Instruct 8B DPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 airoboros3.2 QDT 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NE
NVIDIA-Nemotron-Nano-12B-v2
Nemotron · Mungert
Params12.3B
Context1024K
Q4_K_M7.9 GB
ReasoningTool use
DE
DeepCoder-14B-Preview
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.2 GB
CodingReasoningTool use
IN
INTELLECT 1
Intellect · QuantFactory
Params10.2B
Context8K
Q4_K_M6.2 GB
GGUF
QW
Qwen3.5 9B GGUF OLD
Qwen · AaryanK
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
BL
Blue-Orchid-2x7b
Blue · duyntnet
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
CH
chujiezheng tulu 2 dpo 13b ExPO
Chujiezheng · RichardErkhov
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
CY
Cydonia v1.3 Magnum V4 22B i1
Cydonia · BasedAGI
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
DI
DISC MedLLM
Disc · QuantFactory
Params13.3B
Context4K
Q4_K_M8.6 GB
GGUF
QW
Qwen2.5 Math 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
LL
llama 3 zilo sql
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LF
LFM2.5 8B A1B
Lfm · Mungert
Params8.47B
Context125K
Smallest0.0 GB
GGUF
LL
Llama 3.1 8B BookAdventures
Llama · KoboldAI
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
JA
Jan v1 AIO
Jan · prithivMLmods
Params4.02B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
ME
Megamind v2 VL med
Megamind · digitranslab
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
RW
rwkv7-g1h-2.9b-20260710-ctx10240.pth
Rwkv · RemySkye
Params2.95B
Context1024K
Q4_K_M2.1 GB
Reasoning
LL
Llama 3 Instruct 8B SPPO Iter3 imatrix
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SA
Salamandra 2b
Salamandra · RichardErkhov
Params2.25B
Context8K
Q4_K_M1.5 GB
GGUF
GE
Gargaz gemma 2b romanian better
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
KI
MythoMax L2 Kimiko v2 13b imatrix
Kimi · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
NexaAIDev Octopus v2
Nexaaidev · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Cyber Dolphin 2.9.3 Mistral Nemo 12b Reason
Mistral · HagalazAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Other quants

Keep browsing