Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
RW
rwkv7 g1h 1.5b i1
Rwkv · RemySkye
Params1.53B
Context1024K
Q4_K_M1.1 GB
GR
Granite Guardian 4.1 8b
Granite · ibm-granite
Params8.38B
Context128K
Q4_K_M5.1 GB
ST
stable diffusion 3.5 medium
Stable · city96
Params2.47B
Context—
Q4_K_M1.8 GB
GR
Granite 8b Code Instruct 4k
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
LL
Meta Llama 3 8B Instruct GGUF Imatrix smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
MI
Tamil-Mistral-7B-v0.1
Mistral · RichardErkhov
Params7.39B
Context32K
Q4_K_M4.5 GB
NE
Nemotron 3.5 Embed 8B BF16
Nemotron · W4D
Params7.95B
Context256K
Q4_K_M4.9 GB
OP
OpenELM-3B-Instruct
Openelm · SanctumAI
Params3.04B
Context2K
Q4_K_M1.9 GB
MO
MOSS TTS Realtime
Moss · BricksDisplay
Params2.08B
Context40K
Q4_K_M1.1 GB
QW
Qwen2.5 1.5B Instruct
Qwen · ThomasBaruzier
Params1.54B
Context32K
Q4_K_M1.0 GB
AY
Aya Expanse 8b
Aya · duyntnet
Params8B
Context8K
Q4_K_M5.1 GB
GL
Glm Edge 4b Chat
GLM · zai-org
Params4.33B
Context3K
Q4_K_M2.6 GB
LL
chargoddard llama 2 26b trenchcoat stack
Llama · RichardErkhov
Params25.7B
Context—
Q4_K_M5.5 GB
SW
Swallow-70b-NVE-instruct-hf
Swallow · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
TO
tokyotech llm Swallow 7b NVE instruct hf
Tokyotech · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
Granite 8b Code Instruct
Granite · duyntnet
Params8.05B
Context4K
Q4_K_M4.9 GB
CO
Cosmos Predict2 14B Text2Image
Cosmos · city96
Params14.3B
Context—
Q4_K_M9.5 GB
LL
llava llama 3 8b v1 1 imat
Llama · city96
Params8B
Context8K
Q4_K_M4.9 GB
EX
EXAONE 3.5 2.4B Instruct 2
Exaone · ThomasBaruzier
Params2.67B
Context32K
Q4_K_M1.6 GB
MI
Mistral 7B Instruct DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM2 135M Instruct
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
MI
MiniMax H3 x Z Image
Minimax · joeygambino
Params20.1B
Context—
Smallest11.5 GB
OL
Olmo-3-1025-7B
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
MI
Mistral Nemo Instruct 2407
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
SK
SkyReels V2 I2V 14B 720P
Skyreels · ThePun1sher
Params16.4B
Context—
Q4_K_M10.9 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · ThomasBaruzier
Params7.8B
Context32K
Q4_K_M4.8 GB
LL
Llama 3 Meerkat 8b v1.0
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LI
Lily-Cybersecurity-7B-v0.2
Lily · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
imajev 4b
Qwen · mindchain
Params4.2B
Context256K
Q4_K_M2.7 GB