Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Replete LLM V2 Llama 3.1 8b
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
GE
gemma advanced v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NE
NexusRaven-V2-13B
Nexusraven · duyntnet
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
GR
granite-3b-code-base-128k
Granite · Mungert
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
RA
RakutenAI-7B-chat
Rakutenai · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
LL
KernelLLM
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · PrunaAI
Params10M
Context128K
Q4_K_M0.0 GB
ReasoningTool use
QW
DMind-1-mini
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.1 GB
GGUF
KA
KAT-Dev
Kat · Mungert
Params32.8B
Context128K
Q4_K_M20.2 GB
GGUF
QW
Qwen3 8B
Qwen · QuantFactory
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
oxy 1 small
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
LZ
lzw1008 Emollama 7b
Lzw · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
DA
DASD-4B-Thinking
Dasd · Mungert
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
MO
MobileLLaMA 1.4B Base
Mobilellama · andrijdavid
Params1.36B
Context2K
Q4_K_M0.8 GB
GGUF
NE
NeuralMona_MoE-4x7B
Neuralmona · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
LL
Hermes 2 Pro Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek-R1-Distill-Qwen-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
CO
context 1
Context · nicolasembleton
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
WA
Wanfq FuseLLM 7B
Wanfq · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
NO
Not WizardLM 2 7B
Not · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AU
AutoCoder_S_6.7B
Autocoder · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
FL
flammenai flammen15 gutenberg DPO v1 7B
Flammenai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AS
Aurora faustus 8B LINEAR
Aspire · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Delirium v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PY
pygmalion-2-7b
Pygmalion · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
RESMPDEV Qwen2 Wukong 5B Instruct Sliced
Qwen · RichardErkhov
Params5.75B
Context32K
Q4_K_M3.6 GB
GGUF
AG
AgentEvol 7B
Agentevol · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SH
shieldgemma 2b
Shieldgemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
FL
Flux Fusion V2 4step merge gguf nf4
Flux · Anibaaal
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
LO
Logics-Parsing
Logics · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
GGUF

Other quants

Keep browsing