Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
DI
Distilgpt2
Distilgpt · QuantFactory
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
PH
Phi 3.5 Mini instruct_Uncensored
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
OU
OuteTTS 0.3 1B
Outetts · OuteAI
Params1.19B
Context4K
Q4_K_M0.7 GB
GGUF
KU
Kunoichi-DPO-7B
Kunoichi · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
DE
deepseek ai DeepSeek R1 Distill Llama 8B GGUF smashed
DeepSeek · PrunaAI
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
FL
flux.1 lite 8B alpha
Flux · city96
Params8.16B
Context—
Smallest3.7 GB
GGUF
LE
Leia Swallow 13b
Leia · RichardErkhov
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
GR
Granite 4.0 Tiny Preview BE
Granite · taronaeo
Params6.67B
Context1024K
Q4_K_M4.0 GB
GGUF
AN
anthracite org magnum v2 32b
Anthracite · RichardErkhov
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
QW
MAmmoTH2 8B Plus
Qwen · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
HU
humo
Humo · calcuis
Params1.74B
Context—
Q4_K_M1.2 GB
GGUF
OP
OpenLLM Ro RoLlama2 7b Instruct 2024 05 14
Openllm · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
KU
Kunoichi DPO v2 7B
Kunoichi · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1 Half Naive A
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Arch Function 3B
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use
GR
granite-8b-code-base-128k
Granite · Mungert
Params8.05B
Context125K
Q4_K_M4.8 GB
Coding
OU
OuteTTS 0.2 500M
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
GGUF
NE
NVIDIA Nemotron Labs 3 Puzzle 75B A9B
Nemotron · RemySkye
Params78.3B
Context1024K
Q4_K_M51.6 GB
ReasoningTool use
PH
phi 3 portuguese tom cat 4k instruct
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
QW
finetune-Qwen2-0.5B-codeDataset
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
Meta-Llama-3-8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-experiment-v1-9B
Llama · RichardErkhov
Params8.9B
Context8K
Q4_K_M5.4 GB
GGUF
DE
DeepSeek-R1-Distill-Llama-70B
DeepSeek · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
ReasoningTool use
MA
MAGREF Wan2.1 I2V 14B
Magref · QuantStack
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
DE
DeepSeek V2 Lite
DeepSeek · RichardErkhov
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
GR
granite-4.0-tiny-preview
Granite · Mungert
Params6.67B
Context1024K
Q4_K_M4.2 GB
ReasoningTool use
GE
gemma 2b
Gemma · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
ReAligned Qwen3.5 35B A3B
Qwen · Lazarus-Ai
Params34.7B
Context256K
Smallest12.8 GB
ReasoningTool use
GE
1 800 SHARED TASKS GEMMA2 27B NLI 16bit
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
DE
Deepseek Math 7b Rl
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF

Other quants

Keep browsing