Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
MI
rana shahroz mistral 7b openorca20k
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
Granite 8b Code Base 4k
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
GM
GmshNet 8B v0.1
Gmshnet · hexera-org
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
dolphin 2.8 mistral 7b v02
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Chinese Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.5B
Context32K
Q4_K_M4.5 GB
LL
Llama 3 Patronus Lynx 8B Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GP
gpt2
Gpt · QuantFactory
Params163M
Context1K
Q4_K_M0.1 GB
CH
chujiezheng Starling LM 7B beta ExPO
Chujiezheng · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
Qwen2 1.5B Instruct
Qwen · Goekdeniz-Guelmez
Params1.78B
Context32K
Q4_K_M1.1 GB
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · crusoeai
Params8B
Context1024K
Q4_K_M4.9 GB
RH
rho-math-1b-interpreter-v0.1
Rho · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2 Audio 7B
Qwen · NexaAI
Params7.75B
Context8K
Q4_K_M4.8 GB
MI
UCLA AGI Mistral7B PairRM SPPO Iter3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
deepseek coder 1.3B kexer
DeepSeek · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
QW
Qwen2.5 32B Instruct Abliterated
Qwen · RichardErkhov
Params32.8B
Context32K
Q4_K_M19.9 GB
ST
stabilityai japanese stablelm base gamma 7b
Stabilityai · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
LL
Llama 2 7b Chat Hf Gpt 4 80k Base_Lora
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Strand-Rust-Coder-14B-v1
Qwen · Mungert
Params14.8B
Context32K
Q4_K_M9.3 GB
QW
Fathom-Search-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.6 GB
LL
Llama3 8B Chinese Chat
Llama · Monor
Params8B
Context8K
Q4_K_M4.9 GB
GR
Granite 3b Code Base
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
QW
Qwen1.5-MoE-A2.7B-Chat
Qwen · RichardErkhov
Params14.3B
Context32K
Q4_K_M9.5 GB
AR
Arcee-Agent
Arcee · crusoeai
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen3.6 35B A3B REAM 160 ru agent
Qwen · WaveCut
Params23.1B
Context256K
Q4_K_M14.4 GB
BE
berkeley nest Starling LM 7B alpha
Berkeley · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
LF
LFM2.5 350M RLCD
Lfm · NANI-Nithin
Params354M
Context125K
Q4_K_M0.2 GB
YI
01 ai Yi 9B 200K
Yi · RichardErkhov
Params8.83B
Context256K
Q4_K_M5.3 GB
QW
online-dpo-qwen2-4
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
LL
Vikhr-Llama-3.2-1B-instruct
Llama · Vikhrmodels
Params1.24B
Context128K
Q4_K_M0.8 GB