Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AN
andykcheng unitrend model 8b vllm
Andykcheng · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RW
rwkv7-g1h-7.2b-20260710-ctx10240.pth
Rwkv · RemySkye
Params7.2B
Context1024K
Q4_K_M4.9 GB
Reasoning
ME
Merak 7B v3 Mini Orca Indo
Merak · asyafiqe
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Homunculus
Qwen · QuantFactory
Params12.5B
Context128K
Q4_K_M7.6 GB
ReasoningTool use
MI
Ministral-3-14B-Reasoning-2512
Mistral · Mungert
Params13.5B
Context256K
Q4_K_M8.7 GB
ReasoningTool use
AY
aya expanse 8b
Aya · QuantFactory
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
GR
Granite 4.0 H Tiny Base
Granite · ibm-granite
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
AV
Average Normie v3.69 8B
Average · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
OpenCodeReasoning-Nemotron-32B-IOI
Qwen · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
CodingReasoningTool use
DE
DeepSeek-R1-Distill-Qwen-1.5B
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
ReasoningTool use
DE
deepseek-coder-1.3b-typescript
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
GE
Quill v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
HA
HamSter-0.2
Hamster · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PE
PersianLLaMA 13B Instruct
Persianllama · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.1 GB
GGUF
LL
Llama 3 Nephilim v3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
CodeQwen1.5 7B Trojan Clas2024 Development
Codeqwen · RichardErkhov
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
QW
Josiefied Qwen2.5 1.5B Instruct Abliterated v3
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
YA
yanolja EEVE Korean Instruct 10.8B v1.0
Yanolja · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LF
LFM2-2.6B
Lfm · Mungert
Params2.57B
Context125K
Q4_K_M1.6 GB
Tool use
UN
UNfilteredAI 1B
Unfilteredai · QuantFactory
Params1.06B
Context2K
Q4_K_M0.6 GB
GGUF
DE
DeepSeek V2 Lite Chat
DeepSeek · RichardErkhov
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
MI
K2S3 Mistral 7b v1.2
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama3 KALE LM Chem 1.5 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 Embedding 8B Bf16
Qwen · Mungert
Params7.57B
Context40K
Q4_K_M4.6 GB
EmbeddingTool use
RN
Rnj 1 Instruct Heretic
Rnj · ZuzeTt
Params8.31B
Context32K
Q4_K_M5.1 GB
Tool use
LL
Llama 3 8B Web GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
Qwen2 1.5B
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
LF
LFM2.5 1.2B Instruct
Lfm · ZuzeTt
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
LL
cognitivecomputations Llama 3 8B Instruct abliterated v2 GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Other quants

Keep browsing