Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AS
L3 Aspire Heart Matrix 8B
Aspire · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GP
gpt2-xl
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
MI
BagelMIsteryTour v2 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LI
lightblue reranker 0.5 bin filt
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
EmbeddingTool use
LL
MMed Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
YI
bella bartender 9b yi
Yi · juiceb0xc0de
Params8.83B
Context4K
Q4_K_M5.3 GB
Roleplay
DO
DongfuJiang prm version3 full hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
YI
Yi 6b 200k
Yi · RichardErkhov
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
ST
stable diffusion xl base 1.0
Stable · genai-archive
Params3.47B
Context—
Smallest2.6 GB
GGUF
LL
MaziyarPanahi calme 2.2 llama3 70b
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
VI
MN Chunky Lotus 12B
Violet · QuantFactory
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
SA
Sailor 4B
Sailor · RichardErkhov
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
MI
mistralai Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5 9B Base
Qwen · titan0115
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
LL
Llama3.1 8B Fireplace2
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Sailor2 1B Chat
Sailor · QuantFactory
Params988M
Context32K
Q4_K_M0.7 GB
GGUF
PO
postboxat18 AR400GroqModel
Postboxat · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Pantheon Rp 1.6 12b Nemo
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
IC
IceLatteRP-7b
Icelatterp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
C4Ai Command R7B 12 2024
Command R · duyntnet
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
LL
Sheared LLaMA 1.3B
Llama · Aryanne
Params1.35B
Context4K
Smallest0.8 GB
GGUF
LL
Llama 3 10b It Kor Extented Chang
Llama · RichardErkhov
Params9.78B
Context8K
Q4_K_M6.0 GB
GGUF
QW
MyAlee Qwen Instruct v2 16k v1
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
WI
WizardLM-2-7B-abliterated
Wizardlm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama3.1 8B Cobalt
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RW
rwkv7 g1h 7.2b i1
Rwkv · RemySkye
Params7.2B
Context1024K
Q4_K_M4.9 GB
Reasoning
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · eugenehp
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
GE
Genstruct-7B
Genstruct · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
Smaug 34B v0.1
Smaug · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
quocdat25 fast apply 16bit v0.v16 Qwen2.5 Coder 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding

Other quants

Keep browsing