Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
GO
Google_Medgemma 1.5 4b It
Google · Bercraft
Params3.88B
Context128K
Q4_K_M2.5 GB
FO
FoxEngineAi Mega Destroyer 8x7B
Foxengineai · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
FL
flux kontext
Flux · gguf-org
Params11.9B
Context—
Q4_K_M6.9 GB
AU
AurelPx Percival 01 7b slerp
Aurelpx · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
cognitivecomputations dolphin 2.9.1 llama 3 8b GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 4B
Qwen · QuantFactory
Params4.4B
Context40K
Q4_K_M2.7 GB
WA
Wan2.2 Fun 5B Control Camera
Wan · QuantStack
Params5.25B
Context—
Q4_K_M3.9 GB
SE
Wan2.1 T2V 1.3B SelfForcing VACE
Self · lym00
Params2.15B
Context—
Q4_K_M1.5 GB
AU
AutoGLM Phone 9B
Autoglm · BlcaCola
Params9.4B
Context64K
Q4_K_M6.2 GB
MI
Mistral7B PairRM SPPO Iter2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 1.7B
Qwen · QuantFactory
Params2.03B
Context40K
Q4_K_M1.3 GB
QW
Qwen2 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
PR
prometheus 7b v2 0
Prometheus · AlekseiPravdin
Params7.24B
Context32K
Q4_K_M4.4 GB
LT
LTX 2.3
Ltx · nnick79
Params21B
Context—
Q4_K_M14.2 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context4K
Q4_K_M1.0 GB
CH
Chroma1 Base
Chroma · silveroxides
Params8.9B
Context—
Q4_K_M5.6 GB
LO
longchat 7b v1.5 32k
Longchat · shaowenchen
Params6.74B
Context32K
Smallest2.8 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
maldv winter garden 7b delta
Maldv · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama 3.1 chinese 8b it dpo
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
SE
SeaLLM3 7B Chat
Seallms · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GR
Granite 3.2 8b Instruct
Granite · ibm-research
Params8.17B
Context128K
Q4_K_M4.9 GB
JS
jsfs11 MixtureofMerges MoE 2x7b SLERPv0.9
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
QW
Qwen Image Distill
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
SI
Silicon-Maid-7B
Silicon · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
CA
CarbonVillain En 10.7B v4
Carbonvillain · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
SOLAR-10.7B-Instruct-v1.0
Solar · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
CH
Ph3task3 14B
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
WA
Lynx
Wan · vantagewithai
Params2.1B
Context—
Q4_K_M0.2 GB
MY
MythoMax-L2-13b
Mythomax · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB