Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Clinical BR Mistral 7B v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
hf 100 Llama 3.1 Spellbound StoryWriter 70b instruct 0.3 16bit
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
Midm-2.0-Base-Instruct
Midm · Mungert
Params11.5B
Context32K
Q4_K_M7.1 GB
Tool use
SU
Supra 1.5 50M Instruct Exp Gguf Src
Supra · SupraLabs
Params52M
Context5K
Q4_K_M0.0 GB
GGUF
ST
L3 8B Stheno v3.3 32K
Stheno · QuantFactory
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8B Chinese Chat
Llama · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · andrijdavid
Params4.43B
Context—
Q4_K_M2.9 GB
GGUF
LL
OpenMath-CodeLlama-7b-Python-hf
Llama · Mungert
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
BE
beomi Yi Ko 34B Chat Preview
Beomi · RichardErkhov
Params34.6B
Context2K
Q4_K_M20.8 GB
GGUF
AZ
MN Halide 12b v1.0
Azure · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
GL
Glm Edge V 2b
GLM · zai-org
Params1.59B
Context2K
Q4_K_M1.0 GB
Vision
SA
saishf Top Western Maid 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Schematron-3B
Llama · Mungert
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen3.5 2B Base
Qwen · titan0115
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
RW
RWKV7 2.9B v3 UnlimitedRP Mini Novel Chat Preview
Rwkv · mzwing
Params2.95B
Context1024K
Q4_K_M1.9 GB
GGUF
OU
OuteTTS 0.3 1B
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
GGUF
KO
komodo 7b base
Komodo · ukung
Params6.76B
Context4K
Q4_K_M4.1 GB
GGUF
PE
PersianMind v1.0
Persianmind · asedmammad
Params6.8B
Context2K
Q4_K_M4.1 GB
GGUF
NE
NexusRaven V2 13B
Nexusraven · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
Evil Alpaca 3B L3.2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
DE
Deepseekmath 7b Sft MATH v2
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
EM
emma 6
Emma · MrMeOrYou
Params1.55B
Context4K
Q4_K_M1.0 GB
Coding
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LL
llama3 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
magnum v2 4b
Llama · QuantFactory
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LL
llama 3.1 medprm reward v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 4.0 3B Vision BE
Granite · taronaeo
Params3.66B
Context128K
Q4_K_M2.2 GB
GGUF
QW
polanka qwen2 1.5b v0.1 ckpt 401000
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
QU
Quill v1 imatrix
Quill · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Other quants

Keep browsing