Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
LL
Replete LLM V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
gemma advanced v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
NE
NexusRaven-V2-13B
Nexusraven · duyntnet
Params13B
Context16K
Q4_K_M7.9 GB
GR
granite-3b-code-base-128k
Granite · Mungert
Params3.48B
Context125K
Q4_K_M2.1 GB
RA
RakutenAI-7B-chat
Rakutenai · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
LL
KernelLLM
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · PrunaAI
Params10M
Context128K
Q4_K_M0.0 GB
QW
DMind-1-mini
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.1 GB
KA
KAT-Dev
Kat · Mungert
Params32.8B
Context128K
Q4_K_M20.2 GB
QW
Qwen3 8B
Qwen · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
oxy 1 small
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
LZ
lzw1008 Emollama 7b
Lzw · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
DA
DASD-4B-Thinking
Dasd · Mungert
Params4.02B
Context256K
Q4_K_M2.5 GB
MO
MobileLLaMA 1.4B Base
Mobilellama · andrijdavid
Params1.36B
Context2K
Q4_K_M0.8 GB
NE
NeuralMona_MoE-4x7B
Neuralmona · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
LL
Hermes 2 Pro Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek-R1-Distill-Qwen-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.0 GB
CO
context 1
Context · nicolasembleton
Params20.9B
Context128K
Q4_K_M15.8 GB
WA
Wanfq FuseLLM 7B
Wanfq · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
NO
Not WizardLM 2 7B
Not · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
AU
AutoCoder_S_6.7B
Autocoder · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
FL
flammenai flammen15 gutenberg DPO v1 7B
Flammenai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AS
Aurora faustus 8B LINEAR
Aspire · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Delirium v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
PY
pygmalion-2-7b
Pygmalion · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
RESMPDEV Qwen2 Wukong 5B Instruct Sliced
Qwen · RichardErkhov
Params5.75B
Context32K
Q4_K_M3.6 GB
AG
AgentEvol 7B
Agentevol · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
SH
shieldgemma 2b
Shieldgemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
FL
Flux Fusion V2 4step merge gguf nf4
Flux · Anibaaal
Params11.9B
Context—
Q4_K_M6.9 GB
LO
Logics-Parsing
Logics · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB