Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GO
Google_Medgemma 1.5 4b It
Google · Bercraft
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
FO
FoxEngineAi Mega Destroyer 8x7B
Foxengineai · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
FL
flux kontext
Flux · gguf-org
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
AU
AurelPx Percival 01 7b slerp
Aurelpx · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
cognitivecomputations dolphin 2.9.1 llama 3 8b GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 4B
Qwen · QuantFactory
Params4.4B
Context40K
Q4_K_M2.7 GB
GGUF
WA
Wan2.2 Fun 5B Control Camera
Wan · QuantStack
Params5.25B
Context—
Q4_K_M3.9 GB
GGUF
SE
Wan2.1 T2V 1.3B SelfForcing VACE
Self · lym00
Params2.15B
Context—
Q4_K_M1.5 GB
GGUF
AU
AutoGLM Phone 9B
Autoglm · BlcaCola
Params9.4B
Context64K
Q4_K_M6.2 GB
Vision
MI
Mistral7B PairRM SPPO Iter2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 1.7B
Qwen · QuantFactory
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen2 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
PR
prometheus 7b v2 0
Prometheus · AlekseiPravdin
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LT
LTX 2.3
Ltx · nnick79
Params21B
Context—
Q4_K_M14.2 GB
GGUF
QW
Qwen2.5 Math 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
CH
Chroma1 Base
Chroma · silveroxides
Params8.9B
Context—
Q4_K_M5.6 GB
GGUF
LO
longchat 7b v1.5 32k
Longchat · shaowenchen
Params6.74B
Context32K
Smallest2.8 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
maldv winter garden 7b delta
Maldv · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama 3.1 chinese 8b it dpo
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SE
SeaLLM3 7B Chat
Seallms · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
GR
Granite 3.2 8b Instruct
Granite · ibm-research
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
JS
jsfs11 MixtureofMerges MoE 2x7b SLERPv0.9
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
QW
Qwen Image Distill
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
SI
Silicon-Maid-7B
Silicon · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CA
CarbonVillain En 10.7B v4
Carbonvillain · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
SOLAR-10.7B-Instruct-v1.0
Solar · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CH
Ph3task3 14B
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
WA
Lynx
Wan · vantagewithai
Params2.1B
Context—
Q4_K_M0.2 GB
GGUF
MY
MythoMax-L2-13b
Mythomax · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Other quants

Keep browsing