Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral NeMo Minitron 8B Base
Mistral · RichardErkhov
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
GR
Granite 4.0 H 1b Base
Granite · ibm-granite
Params1.46B
Context1024K
Q4_K_M0.9 GB
GGUF
LI
T lite 0.1
Lite · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Tess 3 7B SFT
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
GR
granite-3b-code-instruct-2k
Granite · Mungert
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
LI
lightblue reranker 0.5 cont
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
EmbeddingTool use
OU
OuteTTS 0.1 350M Hf
Outetts · OuteAI
Params362M
Context4K
Q4_K_M0.3 GB
GGUF
MI
mistral nemo gutenberg 12B v2
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SE
Seed-Coder-8B-Reasoning
Seed · Mungert
Params8.25B
Context64K
Q4_K_M5.2 GB
CodingReasoning
GL
GLM 4.7 Flash
GLM · AaryanK
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
CU
CultriX NeuralCeptrix 7B SLERP
Cultrix · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
granite 4.0 h tiny DISTILL OPUS 4.5 think
Granite · glogwa68
Params7.09B
Context1024K
Q4_K_M4.3 GB
ReasoningTool use
RW
RWKV7-Goose-World3-2.9B-HF
Rwkv · Mungert
Params2.95B
Context1024K
Q4_K_M1.9 GB
GGUF
QW
Qwen2.5 Coder 7B
Qwen · QuantFactory
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingTool use
MI
StructLM 7B Mistral
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Pantheon Rp 1.5 12b Nemo
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
agentflow-planner-7b
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M5.0 GB
Tool use
GR
Granite 4.0 1b Base
Granite · ibm-granite
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF
LL
NousResearch Hermes 2 Pro Llama 3 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Llama3-70B-Fireplace
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
olmOCR-2-7B-1025
Qwen · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
Vision
AR
aragpt2-base
Aragpt · RichardErkhov
Params184M
Context1K
Q4_K_M0.1 GB
GGUF
MI
Mistral Large Instruct 2407
Mistral · RichardErkhov
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · servantofares
Params29.9B
Context198K
Q4_K_M18.5 GB
CodingReasoningRoleplay
HY
MegaHyperLlama3.1
Hyperllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 3 4b It
Gemma · chatpig
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
LL
dakshvar22 cmd gen travel assistant codellama 7b unsloth params
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackexchange reverseengineering
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AI
AIST 87M
Aist · augmem
Params87M
Context—
Smallest0.1 GB
GGUF
WE
WestLake 10.7B v2 GGUF IQ Imatrix
Westlake · Lewdiculous
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay

Other quants

Keep browsing