Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta llama_Meta Llama 3.1 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
LocateAnything-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.4 GB
Tool useVision
GR
Granite 4.2 8B BE
Granite · taronaeo
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
LL
Reflection Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BO
Boogu Image Edit GGUFs
Boogu · realrebelai
Params10.3B
Context—
Smallest6.8 GB
GGUF
QW
Qwen2.5 7B Instruct Uncensored
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · hermes42
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
vicgalle Humanish Roleplay Llama 3.1 8B
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
QW
UIGEN-X-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.2 GB
ReasoningTool use
BA
baichuan2 7b chat
Baichuan · shaowenchen
Params7.51B
Context4K
Smallest3.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
GE
Turkish Gemma 9b T1
Gemma · ytu-ce-cosmos
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
CursorCore QW2.5 1.5B SR
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
TI
TinyLlama v1.1
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama 2 7b Ebft Sparsegpt Outlier Wiki Block Outlier
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
granite-8b-code-instruct
Granite · SanctumAI
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
MA
Mamba gpt 3B v4 ggml and
Mamba · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
LL
LLaMA 3 8B SFR SFT R
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
vicgalle Configurable Llama 3.1 8B Instruct
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2 7B Instruct Step DPO
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
IN
instruction synthesizer
Instruction · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
GE
gemma 2b it GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
llama2-7b-chat-hf-v3
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Mistral 7B Holodeck 1
Mistral · KoboldAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MX
mxbai-rerank-large-v2
Mxbai · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
EmbeddingTool use
PH
Phi-4-reasoning-plus
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
CodingReasoning
SE
SeaLLMs v3 1.5B Chat
Seallms · RichardErkhov
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
MI
Mistral Ita 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
SWE-agent-LM-32B
Qwen · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
CodingTool use

Other quants

Keep browsing