Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Finnish NLP llama 7b finnish instruct v0.2
Llama · RichardErkhov
Params7B
Context2K
Q4_K_M4.3 GB
LL
Magpie Align Llama 3 8B Magpie Align v0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
XL
xLAM-2-32b-fc-r
Xlam · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
QW
Smoothie Qwen3 AIO
Qwen · prithivMLmods
Params596M
Context40K
Q4_K_M0.4 GB
LT
unsloth ltx 2 3
Ltx · fwwrsd
Params21B
Context—
Q4_K_M14.2 GB
MP
mpt-7b-8k-chat
Mpt · duyntnet
Params6.65B
Context8K
Q4_K_M4.3 GB
LL
posicube Llama2 chat AYB 13B
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
SA
Salamandra 7b
Salamandra · RichardErkhov
Params7.77B
Context8K
Q4_K_M4.9 GB
LL
Leo Hessianai 7b P1 Llama Errors P2 GEC
Llama · RichardErkhov
Params6.74B
Context8K
Q4_K_M4.1 GB
HJ
Hjgugugjhuhjggg mergekit ties ysreuuq
Hjgugugjhuhjggg · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
YO
Youri 7b
Youri · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
PH
wenlianghuang Phi3 finance Matt
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
QW
Qwen3 4B v0.4 deepresearch no think 4
Qwen · QuantFactory
Params4.41B
Context40K
Q4_K_M2.7 GB
JA
Japanese Stablelm 3b 4e1t Instruct
Japanese · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
GR
granite-guardian-3.0-8b
Granite · Mungert
Params8.17B
Context8K
Q4_K_M4.9 GB
LL
Llama3 70B Chinese Chat
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LF
LFM2.5-24B-A2B-DERISKED
Lfm · freakyskittle
Params24B
Context128K
Q4_K_M14.5 GB
GP
p208p2002 gpt2 squad nqg hl
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
QW
Qwen3.6 35B A3B REAM 160 ru agent
Qwen · BahamutRU
Params35B
Context—
Q4_K_M14.4 GB
LF
LFM2-1.2B-Tool
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.8 GB
LL
Llama SmolTalk 3.2 1B Instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
NE
Nexusflow NexusRaven V2 13B GGUF smashed
Nexusflow · PrunaAI
Params13B
Context16K
Q4_K_M7.9 GB
EE
EEVE Korean 10.8B Instruct v4 Sft
Eeve · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
AE
Aethora 7b v1 imatrix
Aethora · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
HE
HelpingAI Lite
Helpingai · OEvortex
Params1.1B
Context2K
Q4_K_M0.7 GB
HE
HelpingAI 15B
Helpingai · QuantFactory
Params15.3B
Context4K
Q4_K_M9.3 GB
MI
lucid-v1-nemo
Mistral · Mungert
Params12.2B
Context128K
Q4_K_M7.6 GB
TR
travel_microsoft_DialoGPT Small
Travel · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB