Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 32B AGI
Qwen · BasedAGI
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
NI
L3.1 Celestial Stone 2x8B
Niitama · QuantFactory
Params13.7B
Context128K
Q4_K_M8.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
LL
Llama 3.1 SauerkrautLM 8b Instruct
Llama · AlekseiPravdin
Params7.81B
Context128K
Q4_K_M4.8 GB
GGUF
RA
RakutenAI 7B chat
Rakutenai · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama 3 8b 64k PoSE
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Unichat llama3 Chinese 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.0 H 350m
Granite · mrutkows
Params340M
Context1024K
Q4_K_M0.2 GB
Tool use
QW
Qwen3.5-122B-A10B
Qwen · Mungert
Params122B
Context256K
Q4_K_M75.4 GB
ReasoningTool useVision
QW
Qwen2.5 7B Instruct Abliterated v2
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen Image Edit Rapid AIO
Qwen · Dsaf69
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
PH
calme-2.1-phi3.5-4b
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
CH
ChaoticNeutrals Prima LelantaclesV5 7b
Chaoticneutrals · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · BasedAGI
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
AP
Apriel-1.6-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
ReasoningTool useVision
MI
MiniCPM V 4.7 1B
MiniCPM · theokiGuyOKI
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
GE
Abliterated
Gemma · anlord
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
LF
LFM2.5 8B A1B
Lfm · RemySkye
Params8.47B
Context125K
Q4_K_M5.2 GB
ReasoningTool use
GE
boto-9B-GGUF
Gemma · lucianosb
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mistral 22B v0.2 GGUF smashed
Mistral · PrunaAI
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
WA
wavecoder ultra 6.7b
Wavecoder · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 3 Swallow 70B v0.1
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SP
SparseLlama 3 8B Pruned_50.2Of4
Sparsellama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · QuantFactory
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
GE
Gemma 2 9b It WPO HB
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
lb reranker 0.5B v1.0
Qwen · QuantFactory
Params630M
Context32K
Q4_K_M0.5 GB
EmbeddingTool use
PO
Poro 34B
Poro · RichardErkhov
Params34B
Context7K
Q4_K_M22.4 GB
GGUF
QW
Qwen2 VL 2B Instruct
Qwen · turingevo
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
MI
mini magnum 12b v1.1
Mini · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Other quants

Keep browsing