Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
TA
Taiwan-LLM-7B-v2.0.1-chat
Taiwan · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
PR
PranavHarshan MedNarraT
Pranavharshan · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Instruct
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
VI
Vikhr 7B instruct 0.4
Vikhr · Vikhrmodels
Params7.63B
Context32K
Q4_K_M4.6 GB
BL
bluuwhale L3 SthenoMaidBlackroot 8B V1
Bluuwhale · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 7B Instruct abliterated v2
Qwen · rbinrs
Params7.62B
Context32K
Q4_K_M4.7 GB
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · esc4late
Params29.9B
Context198K
Q4_K_M18.5 GB
LL
Llama 3.2 Taiwan 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
GE
ihopper ko gemma 7b sft dpo v1.0
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
MI
MistralInstructLongish
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral epoch1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
AIML GEEK promptv2 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
mlfoundations dev llama2 oh teknium scaling down random 0.1
Llama · RichardErkhov
Params7B
Context4K
Q4_K_M4.1 GB
GE
Gemma 2 27b Chatml
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
ST
Stablelm 3b 4e1t
Stablelm · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
LL
Llama 3.1 Minitron 4B Depth Base
Llama · QuantFactory
Params4.54B
Context128K
Q4_K_M2.8 GB
MI
avemio digital Mistral 7b orpo 3000 steps Prune
Mistral · RichardErkhov
Params5.06B
Context32K
Q4_K_M3.0 GB
GR
grok 1
Grok · RichardErkhov
Params316B
Context8K
Smallest65.5 GB
LL
AndreyRzhaksinskiy CDS CodeLlama Ins 7b E2E 20241022
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
ME
mem agent
Mem · QuantFactory
Params4.41B
Context256K
Q4_K_M2.7 GB
QW
oxy 1 micro
Qwen · QuantFactory
Params1.78B
Context32K
Q4_K_M1.1 GB
QW
Qwen2.5 0.5B Instruct
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
ZO
zomd AISquare Instruct yi ko 6b v0.9.30
Zomd · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GP
OpenAi GPT oss 20b abliterated uncensored NEO Imatrix
gpt-oss · jingamin
Params20.9B
Context128K
Smallest15.7 GB
WA
wan 1.3b
Wan · alvago
Params127M
Context—
Q4_K_M1.0 GB
HE
Heimer kto TinyLlama 1.1B
Heimer · tsunemoto
Params1.1B
Context2K
Q4_K_M0.7 GB
NO
nota ai st vicuna v1.3 5.5b taylor
Nota · RichardErkhov
Params5.52B
Context2K
Q4_K_M3.3 GB
GE
Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
MI
MiniMax M2.1
Minimax · AaryanK
Params229B
Context192K
Q4_K_M138.3 GB
TE
TeenyTinyLlama-460m-Chat
Teenytinyllama · RichardErkhov
Params468M
Context2K
Q4_K_M0.3 GB