Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
ME
meditron-7b
Meditron · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
HI
higgs
Higgs · calcuis
Params5.77B
Context—
Q4_K_M4.5 GB
QW
Qwen3-0.6B-abliterated
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · ThomasBaruzier
Params7.82B
Context4K
Q4_K_M4.8 GB
QW
Qwen2 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Skywork Critic Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GH
Ghost 8b Beta 1608
Ghost · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
YI
Yi 1.5 6B
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
LL
finance Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
InstructLM 1.3B
Instructlm · QuantFactory
Params1.35B
Context2K
Q4_K_M0.8 GB
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3.1 s instruct v0.2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
MiniChat 1.5 3B
Minichat · tsunemoto
Params3.02B
Context4K
Q4_K_M1.8 GB
SP
spicyboros-7b-2.2
Spicyboros · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3 Instruct 8B SimPO ExPO
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GR
Granite 4.0 H Small BE
Granite · taronaeo
Params32.2B
Context1024K
Q4_K_M19.5 GB
QW
QwQ 32B
Qwen · brittlewis12
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Llama 3 Instruct 8B SPPO Iter3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 8B Magpie Air MT SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
EU
EuroLLM 9B Instruct
Eurollm · QuantFactory
Params9.15B
Context4K
Q4_K_M5.6 GB
LL
Llama 3.1 SuperNova Lite
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
YO
Youtu LLM 2B
Youtu · AaryanK
Params1.96B
Context128K
Q4_K_M1.2 GB
LL
saiga llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 8B Instruct abliterated v3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Tongda1 1.5B BKI
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
CO
codegeex4-all-9b
Codegeex · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
GL
Glyph
GLM · Mungert
Params9.4B
Context128K
Q4_K_M6.6 GB
GR
Granite 4.0 Micro Base
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB