Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
PH
Phi-4-mini-reasoning
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
TR
Trinity-Nano-Preview
Trinity · Mungert
Params6.12B
Context128K
Q4_K_M4.0 GB
LL
Llama 3 8B Instruct 262k
Llama · Monor
Params8.03B
Context256K
Q4_K_M4.9 GB
QW
Qwen3-VL-30B-A3B-Instruct
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
NO
nothingiisreal MN 12B Starcannon v3
Nothingiisreal · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
Marco o1
Marco · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
LL
scb10x llama 3 typhoon v1.5x 70b instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
LLaMA 3 8B SFR Iterative DPO R
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GE
gemma 2 baku 2b it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma-2b
Gemma · mlabonne
Params2.51B
Context8K
Q4_K_M1.5 GB
BI
BioMistral 7B
Biomistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
OmniLing V1 8b experimental
Lite · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Candle Mistral 7B Instruct v0.1
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
VI
vicgalle ConfigurableHermes 7B
Vicgalle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 13B Instruct v0.1 GGUF smashed
Llama · PrunaAI
Params13.3B
Context8K
Q4_K_M8.1 GB
AL
AlphaMonarch 7B imatrix
Alphamonarch · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
GLM 4.7 Flash Grande Heretic UNCENSORED 42B A3B
GLM · DavidAU
Params42B
Context198K
Q4_K_M25.8 GB
MI
Candle llava v1.6 mistral 7b
Mistral · DanielClough
Params7.57B
Context—
Smallest2.5 GB
RE
Refact 1 6 base
Refact · QuantFactory
Params1.59B
Context4K
Q4_K_M1.0 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
AesCoder-4B
Qwen · Mungert
Params4.41B
Context256K
Q4_K_M3.0 GB
SM
SmolLM 1.7B
SmolLM · QuantFactory
Params1.71B
Context2K
Q4_K_M1.1 GB
GE
Gemma2 9B TitanFusion
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
TE
TextBase 7B v0.1
Textbase · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
ScaduTorrent1.1 8b model stock
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Instruct 8B SimPO
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
Husky v1 Math Deepseekmath 7b Instruct
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
nbeerbower bophades mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Sailor2 20B Chat
Sailor · duyntnet
Params19.2B
Context32K
Q4_K_M11.6 GB
LL
llama 3 Korean Bllossom 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB