Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
HU
hunyuan
Hunyuanvideo · calcuis
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
JS
jsfs11 MixtureofMerges MoE 2x7bRP v8
Jsfs · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
CO
Chromadb Context 1
Context · ryancook
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
QW
Qwen3 0.6B
Qwen · duyntnet
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
QW
Qwen3.5 35B A3B
Qwen · titan0115
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
MI
MinerU2.5-2509-1.2B
Mineru · Mungert
Params494M
Context16K
Q4_K_M0.4 GB
Vision
GE
Rumeni 1 Nano
Gemma · kirilldual0987
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningVision
DE
DeepScaleR 1.5B Preview Abliterated
Deepscaler · ThomasBaruzier
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
HI
HiDream I1 Fast
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
GGUF
GR
granite-7b-base
Granite · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QW
qwen2.5 reinstruct alternate lumen 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
DE
Deepthink Reasoning 7B imatrix
Deepthink · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
WI
WizardLM 13B Uncensored
Wizardlm · QuantFactory
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Meta Llama 3 8B Instruct GGUF v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8b It Translation Sharegpt En Ko
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GR
granite 7b lab
Granite · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama3.2 3B Enigma
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
Coding
QW
Qwen2.5 Coder 7B Instruct
Qwen · ThomasBaruzier
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MI
grimjim Mistral Starling merge trial3 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OL
Olmo-3-7B-Think
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
Reasoning
MI
philosophy mistral
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
MA
MAmmoTH2 7B
Mammoth · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
MOSS Image
Moss · PALLER-NOVUS
Params5.08B
Context—
Smallest1.2 GB
GGUF
ME
MediX R1 8B
Medix · MBZUAI
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningVision
LL
Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MI
MiniCPM5 2B
MiniCPM · NANI-Nithin
Params2.52B
Context128K
Q4_K_M1.6 GB
Tool use
GH
Ghost 7b Alpha
Ghost · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
hf 100 Llama 3.1 Spellbound StoryWriter 0.1 vllm 16bit
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF

Other quants

Keep browsing