Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TA
Taiwan-LLM-7B-v2.0.1-chat
Taiwan · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PR
PranavHarshan MedNarraT
Pranavharshan · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
VI
Vikhr 7B instruct 0.4
Vikhr · Vikhrmodels
Params7.63B
Context32K
Q4_K_M4.6 GB
GGUF
BL
bluuwhale L3 SthenoMaidBlackroot 8B V1
Bluuwhale · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 7B Instruct abliterated v2
Qwen · rbinrs
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · esc4late
Params29.9B
Context198K
Q4_K_M18.5 GB
CodingReasoningRoleplay
LL
Llama 3.2 Taiwan 3B Instruct
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
Reasoning
GE
ihopper ko gemma 7b sft dpo v1.0
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MI
MistralInstructLongish
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral epoch1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
AIML GEEK promptv2 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
mlfoundations dev llama2 oh teknium scaling down random 0.1
Llama · RichardErkhov
Params7B
Context4K
Q4_K_M4.1 GB
GGUF
GE
Gemma 2 27b Chatml
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
ST
Stablelm 3b 4e1t
Stablelm · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
Llama 3.1 Minitron 4B Depth Base
Llama · QuantFactory
Params4.54B
Context128K
Q4_K_M2.8 GB
GGUF
MI
avemio digital Mistral 7b orpo 3000 steps Prune
Mistral · RichardErkhov
Params5.06B
Context32K
Q4_K_M3.0 GB
GGUF
GR
grok 1
Grok · RichardErkhov
Params316B
Context8K
Smallest65.5 GB
GGUF
LL
AndreyRzhaksinskiy CDS CodeLlama Ins 7b E2E 20241022
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ME
mem agent
Mem · QuantFactory
Params4.41B
Context256K
Q4_K_M2.7 GB
GGUF
QW
oxy 1 micro
Qwen · QuantFactory
Params1.78B
Context32K
Q4_K_M1.1 GB
Roleplay
QW
Qwen2.5 0.5B Instruct
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
ZO
zomd AISquare Instruct yi ko 6b v0.9.30
Zomd · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
GP
OpenAi GPT oss 20b abliterated uncensored NEO Imatrix
gpt-oss · jingamin
Params20.9B
Context128K
Smallest15.7 GB
Tool use
WA
wan 1.3b
Wan · alvago
Params127M
Context—
Q4_K_M1.0 GB
GGUF
HE
Heimer kto TinyLlama 1.1B
Heimer · tsunemoto
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
NO
nota ai st vicuna v1.3 5.5b taylor
Nota · RichardErkhov
Params5.52B
Context2K
Q4_K_M3.3 GB
GGUF
GE
Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MI
MiniMax M2.1
Minimax · AaryanK
Params229B
Context192K
Q4_K_M138.3 GB
CodingReasoningTool use
TE
TeenyTinyLlama-460m-Chat
Teenytinyllama · RichardErkhov
Params468M
Context2K
Q4_K_M0.3 GB
GGUF

Other quants

Keep browsing