Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
Glm Edge V 5b
GLM · zai-org
Params4.33B
Context3K
Q4_K_M2.6 GB
Vision
LL
Hermes 3 Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Qwen3-VL-4B-Instruct
Qwen · Mungert
Params4.02B
Context256K
Q4_K_M2.6 GB
Tool useVision
MI
nbeerbower Gutensuppe mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
KA
Karakuri Lm 7b Apm v0.1
Karakuri · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
QW
QwQ 32B Preview
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
GR
Granite Vision 3.3 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
DA
L3 DARKER PLANET Broken Land 12.15B
Darker · QuantFactory
Params12.2B
Context8K
Q4_K_M7.4 GB
GGUF
FL
flux controlnet
Flux · licyk
Params11.9B
Context—
Smallest5.2 GB
GGUF
HE
G9v3 3B Heretic Abliterated
Heretic · Vortecks
Params3B
Context128K
Q4_K_M1.8 GB
Tool use
LL
DuckDB NSQL 7B v0.1
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DA
Loki v2.6 8b 1024k
Daybreak · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
Roleplay
GE
Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ST
L3 SthenoMaid 8B V1
Sthenomaidblackroot · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
Codegeex4 All 9b
Codegeex · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
OU
OuteTTS 1.0 0.6B
Outetts · OuteAI
Params602M
Context40K
Q4_K_M0.4 GB
GGUF
LL
Replete Coder V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
DE
deepseek-coder-1.3b-chat-and-function-calling
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
CodingTool use
LT
ltx video 2b v0.9.1
Ltx · pollockjj
Params1.92B
Context—
Smallest0.7 GB
GGUF
ML
mlfoundations dev stackoverflow 5000tasks 1p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · LiteLLMs
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LA
Labradorite 13b
Labradorite · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.2 3B
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
ReasoningRoleplayTool use
VI
Vikhrmodels/Vikhr-YandexGPT-5-Lite-8B-it
Vikhrmodels · Vikhrmodels
Params8.04B
Context32K
Q4_K_M4.9 GB
GGUF
HO
holo
Holo · gguf-org
Params4.07B
Context—
Q4_K_M4.1 GB
GGUF
QW
Rombos LLM V2.6 Qwen 14b
Qwen · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
QW
Qwen2.5 Coder 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MI
Dans-PersonalityEngine-V1.3.0-24b
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay

Other quants

Keep browsing