Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Open Insurance LLM Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
selfrag llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
OneSQL v0.2 Qwen 1.5B
Qwen · onekq-ai
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
GE
GeM2 Llamion 14B Base
Gem · RichardErkhov
Params14.5B
Context4K
Q4_K_M8.8 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · RichardErkhov
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
GE
gemma 2b it
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Mistral-7B-OpenOrca
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EI
J.O.S.I.E.3 Beta4 slerp
Einstein · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
NextCoder-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
CodingTool use
AR
archangel_sft_pythia2-8b
Archangel · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
MI
Mistral 7B Base SFT SimPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
GRMR 2B Instruct old
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
JE
Jellyfish-13B
Jellyfish · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · URWI08RUS
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingTool use
LT
LTX 2.3
Ltx · Viral2AI
Params21B
Context—
Q4_K_M14.3 GB
GGUF
LL
reflection llama 3.1 8B Solshine Full
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama 3 8b instruct 262k chinese
Llama · Monor
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
KA
kalisai Nusantara 2.7b Indo Chat
Kalisai · RichardErkhov
Params2.65B
Context8K
Q4_K_M1.7 GB
GGUF
FL
Flan T5 Xxl
Flan · dumb-dev
Params11.1B
Context512
Q4_K_M6.8 GB
GGUF
MI
Mistral 7B Erebus v3
Mistral · KoboldAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
AIML GEEK advanced promptv2 finetuned CodeLlama7b Instruct
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama OuteTTS 1.0 1B
Llama · BricksDisplay
Params74M
Context—
Q4_K_M0.0 GB
GGUF
PH
Phi 3 mini 4k instruct Matter 0.1 Slim A
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
GR
granite-3.3-8b-instruct
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
WA
Pornai
Wan · wedik66
Params5.25B
Context—
Q4_K_M3.9 GB
GGUF
GE
google gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
DE
Fathom-R1-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.1 GB
ReasoningTool use
ME
Meltemi 7B Instruct v1.5
Meltemi · QuantFactory
Params7.48B
Context32K
Q4_K_M4.5 GB
GGUF

Other quants

Keep browsing