Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
RW
RWKV6 7B v3 Porn Chat
Rwkv · mzwing
Params7.64B
Context1024K
Q4_K_M4.8 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
LL
Llama 8b Gemini Point21 60 Wo Cot
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Syouf llamaWithoutGuff
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GG
ggml CLIP ViT B 32 laion2B s34B b79K
Ggml · mys
Params151M
Context—
Smallest0.0 GB
DE
deepseek coder 7b instruct v1.5
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
LL
NousResearch Hermes 2 Pro Llama 3 70B GGUF smashed
Llama · PrunaAI
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 2 7b Pruned70 Retrained
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
PO
PocketSurvivor 3B
Pocketsurvivor · mfielding92
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Prosparse Llama 2 7b
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
CO
CompassJudger 1 32B Instruct
Compassjudger · RichardErkhov
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Google Gemma 2 27b
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
MI
Mistral Small 24B Instruct 2501 reasoning
Mistral · brittlewis12
Params23.6B
Context32K
Q4_K_M14.3 GB
HA
haes95 cdlm 7 ko nl2sql v1.0
Haes · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
smol_llama-220M-openhermes
Llama · RichardErkhov
Params218M
Context2K
Q4_K_M0.1 GB
GE
Ruqiya gemma2 2b fine tuned arabic dataset
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
mlfoundations dev llama2 oh teknium scaling down random 0.7
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
AC
AceMath-7B-Instruct
Acemath · Mungert
Params7.62B
Context4K
Q4_K_M4.8 GB
LL
Meta Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
DI
diffusionfamily diffullama
Diffusionfamily · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
mistral nemo cc 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
NX
Nxcode-CQ-7B-orpo
Nxcode · RichardErkhov
Params7.25B
Context64K
Q4_K_M4.7 GB
JA
japanese-stablelm-instruct-ja_vocab-beta-7b
Japanese · RichardErkhov
Params6.88B
Context4K
Q4_K_M4.2 GB
ME
Meltemi 7B Instruct v1
Meltemi · RichardErkhov
Params7.48B
Context32K
Q4_K_M4.5 GB
DE
DeepSeek-R1-Distill-Qwen-7B
DeepSeek · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
RW
rwkv7-g1h-1.5b-20260710-ctx10240.pth
Rwkv · RemySkye
Params1.53B
Context1024K
Q4_K_M1.1 GB
SK
SkyReels V2 DF 14B 540P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
HO
HopCoder Mini 35B A3B VL36 fullsft
Hopcoder · TaimoorSiddiqui
Params35B
Context256K
Q4_K_M21.2 GB
LL
Devarui379 VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB