Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
meditron-7b
Meditron · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
HI
higgs
Higgs · calcuis
Params5.77B
Context—
Q4_K_M4.5 GB
GGUF
QW
Qwen3-0.6B-abliterated
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
EX
EXAONE 3.0 7.8B Instruct
Exaone · ThomasBaruzier
Params7.82B
Context4K
Q4_K_M4.8 GB
GGUF
QW
Qwen2 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Skywork Critic Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GH
Ghost 8b Beta 1608
Ghost · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
YI
Yi 1.5 6B
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
LL
finance Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
InstructLM 1.3B
Instructlm · QuantFactory
Params1.35B
Context2K
Q4_K_M0.8 GB
GGUF
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3.1 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
MI
MiniChat 1.5 3B
Minichat · tsunemoto
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
SP
spicyboros-7b-2.2
Spicyboros · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 Instruct 8B SimPO ExPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.0 H Small BE
Granite · taronaeo
Params32.2B
Context1024K
Q4_K_M19.5 GB
GGUF
QW
QwQ 32B
Qwen · brittlewis12
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
LL
Llama 3 Instruct 8B SPPO Iter3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Magpie Air MT SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EU
EuroLLM 9B Instruct
Eurollm · QuantFactory
Params9.15B
Context4K
Q4_K_M5.6 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
YO
Youtu LLM 2B
Youtu · AaryanK
Params1.96B
Context128K
Q4_K_M1.2 GB
CodingReasoningTool use
LL
saiga llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
Meta Llama 3 8B Instruct abliterated v3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Tongda1 1.5B BKI
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
CO
codegeex4-all-9b
Codegeex · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
GL
Glyph
GLM · Mungert
Params9.4B
Context128K
Q4_K_M6.6 GB
ReasoningTool useVision
GR
Granite 4.0 Micro Base
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF

Other quants

Keep browsing