Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
ELYZA Japanese Llama 2 7b Instruct
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · RichardErkhov
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
GE
micks99 gemma 2b instruct ft Data Analytics Digital Marketing Project Management QAv2
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 3 270m it
Gemma · QuantFactory
Params436M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3.5 4B
Qwen · titan0115
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
pokee_research_7b
Qwen · Mungert
Params7.6B
Context32K
Q4_K_M5.0 GB
GGUF
GR
Granite 4.0 Tiny Base Preview
Granite · ibm-granite
Params6.67B
Context1024K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.1 8B ArliAI Formax v1.0
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
WA
Ditto
Wan · vantagewithai
Params3.05B
Context—
Q4_K_M2.0 GB
GGUF
QW
Qwen2.5 Coder 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
MI
nbeerbower bophades v2 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WA
WAN2.2 I2V A14B DISTILL LIGHTX2V 4STEP
Wan · timfromhcs
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Qwen1.5-7B-Chat
Qwen · duyntnet
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
GE
gemma 4 E2B
Gemma · Jessylg27
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
WA
Wan2.2 TI2V 5B
Wan · suyehb
Params5B
Context—
Q4_K_M3.4 GB
GGUF
HA
Hare-1.1B-base
Hare · RichardErkhov
Params1.12B
Context32K
Q4_K_M0.7 GB
GGUF
WI
WizardLM 2 8x22B
Wizardlm · LiteLLMs
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
OCRFlux-3B
Qwen · Mungert
Params3.4B
Context125K
Q4_K_M2.2 GB
Tool useVision
OP
OpenHermes 2.5 Code 290k 13B
Openhermes · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
CodingTool use
BE
benhaotang nemo math science philosophy 12B
Benhaotang · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen Image Edit 2511
Qwen · Chxiguni
Params20.4B
Context—
Q4_K_M13.2 GB
GGUF
DR
Dragonwar 7b Alpha
Dragonwar · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
openai community gpt2
Openai · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
MI
Devstral Small 2507
Mistral · brittlewis12
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
LU
NarraThinker12B
Lumimaid · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
BL
bloomz 560m
Bloomz · QuantFactory
Params816M
Context2K
Q4_K_M0.6 GB
Coding
QW
VibeThinker-1.5B
Qwen · Mungert
Params1.78B
Context128K
Q4_K_M1.3 GB
CodingTool use
LL
ArliAI Llama 3 8B Dolfin v0.3
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
JA
Jan-v2-VL-low
Jan · janhq
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision

Other quants

Keep browsing