Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Unichat llama3 Chinese 8B 28K
Llama · Monor
Params8.03B
Context8K
Q4_K_M4.9 GB
NO
nota ai st vicuna v1.3 10.5b ppl
Nota · RichardErkhov
Params10.5B
Context2K
Q4_K_M6.3 GB
TR
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
Truthful · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
LL
Meta Llama Llama 3.2 3B Instruct
Llama · aashish1904
Params3.21B
Context128K
Q4_K_M2.0 GB
UI
UIGEN X 4B 0729
Uigen · duyntnet
Params4.41B
Context40K
Q4_K_M2.7 GB
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
IB
ibivibiv aegolius acadicus v1 30b
Ibivibiv · RichardErkhov
Params29.8B
Context32K
Q4_K_M18.0 GB
MI
Minerva
Minerva · RichardErkhov
Params2.89B
Context16K
Q4_K_M1.8 GB
GE
Gemma 2 9b Chatml
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 3.1 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
saqada Llama 3.1 8B with 16bit merged lora adapters MOV v7
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
QuantumIntelligence QI mistral 7B slerp
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
deepseek-coder-33b-instruct
DeepSeek · RichardErkhov
Params33.3B
Context16K
Q4_K_M19.9 GB
LL
LLaMA3 iterative DPO final
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
JE
Jellyfish 8B
Jellyfish · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
ML
mlfoundations dev stackoverflow 10000tasks 1p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
RW
rwkv7-2.9B-world
Rwkv · Mungert
Params2.95B
Context1024K
Q4_K_M1.9 GB
LL
RLHFlow LLaMA3 iterative DPO final
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
YC
ycros BagelMIsteryTour 8x7B
Ycros · RichardErkhov
Params57.6B
Context32K
Q4_K_M28.4 GB
LL
LLaMAntino 2 Chat 7b Hf UltraChat ITA
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
CA
canarim 7B
Canarim · lucianosb
Params6.74B
Context4K
Q4_K_M4.1 GB
AM
amazingvince Not WizardLM 2 7B
Amazingvince · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
OneLLM Doey V1 Llama 3.2 1B it
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
gemma 2 9b it DPO
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
E5 R Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Fireball Alpaca Llama3.1.08 8B C R1 KTO Relection
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 2 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
BR
BroAlanTaps GPT2 large 256 16500steps
Broalantaps · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
VO
Voxtral Mini 3B 2507
Voxtral · Bercraft
Params4.68B
Context—
Smallest1.6 GB
RE
reflect_llm8B_Om2SftT1-Om2G8kOm2AgIpsdpIter1T1_b1.0
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB