Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
TR
Translategemma 4b It
Translategemma · tatsuyaaaaaaa
Params3.88B
Context128K
Q4_K_M2.5 GB
SM
SmolLM2 360M Instruct
SmolLM · QuantFactory
Params362M
Context8K
Q4_K_M0.3 GB
LI
T lite instruct 0.1
Lite · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · PrunaAI
Params3.61B
Context128K
Q4_K_M2.2 GB
NE
neural-chat-7b-v3-3
Neural · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
VA
VAGOsolutions SauerkrautLM 7b HerO
Vagosolutions · RichardErkhov
Params3.8B
Context—
Q4_K_M2.2 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
microsoft LLaMA 2 7b GTL Delta
Llama · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · Goekdeniz-Guelmez
Params7B
Context32K
Q4_K_M4.7 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
IN
InternLM2StepProver
InternLM · QuantFactory
Params7.74B
Context8K
Q4_K_M4.7 GB
TY
Typhoon 7b Instruct 02 19 2024
Typhoon · RichardErkhov
Params7.27B
Context32K
Q4_K_M4.4 GB
LL
LLaMA 2 7B 32K
Llama · rozek
Params6.74B
Context32K
Q4_K_M4.1 GB
CH
MN Chthonia 12B i1
Chthonia · BasedAGI
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
Reasoning 0.5b
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
MI
MistarlingMaid 2x7B Base
Mistarlingmaid · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
QW
Qwen2.5 Coder 7B
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
BR
Breeze 7B 32k Base V1_0
Breeze · RichardErkhov
Params7.49B
Context32K
Q4_K_M4.5 GB
DE
NuminaMath 7B CoT
DeepSeek · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
HE
HelpingAI Lite
Helpingai · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
WI
WizardLM-13B-V1.2
Wizardlm · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GL
glm-4-9b-chat
GLM · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
LL
Llama 3 Yggdrasil 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
RW
Rwkv7 G1 1.5b Instruct Preview
Rwkv · mzwing
Params1.53B
Context1024K
Q4_K_M1.0 GB
LL
Llama 3 Groq 8B Tool Use
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
genesis-4B-DEMO
Genesis · epsill0n
Params4.21B
Context256K
Q4_K_M2.7 GB
IN
InstructLM 500M
Instructlm · QuantFactory
Params568M
Context2K
Q4_K_M0.4 GB
LL
FireStorm Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Artificium llama3.1 8B 001
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB