Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
LightOnOCR-2-1B
Lightonocr · Mungert
Params596M
Context16K
Q4_K_M0.4 GB
Vision
QW
Vikhr-Qwen-2.5-1.5B-Instruct
Qwen · Vikhrmodels
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3-Reranker-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
GE
Gemma 2 2b It
Gemma · ThomasBaruzier
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
EU
Eurus 7b kto
Eurus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
LL
FineLlama 3.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GL
Glm Edge 1.5b Chat
GLM · zai-org
Params1.59B
Context2K
Q4_K_M1.0 GB
GGUF
CO
Yi Coder 9B
Coder · QuantFactory
Params8.8B
Context128K
Q4_K_M5.3 GB
Coding
LL
Meta llama_Meta Llama 3 8B Instruct
Llama · ThomasBaruzier
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
WA
Wan2.1 Fun 14B InP
Wan · city96
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
QW
Qwen2 Boundless
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · calcuis
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Aspire1.2 8B TIES
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
RoleplayTool use
LL
Llama 3 8B ProLong 64k Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 8B Chinese Chat
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Turkish Llama 8b Instruct v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
RH
rho math 1b interpreter v0.1
Rho · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama3.2 3B ShiningValiant2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
NE
NeuralDaredevil 7B
Neuraldaredevil · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
palmyra mini thinking AIO
Palmyra · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.0 GB
CodingReasoning
SK
SkyReels V2 T2V 14B 540P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
MI
PVD 160k Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3-Reranker-0.6B
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
MI
K2S3 Mistral 7b v1.48
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
OP
OpenELM-450M
Openelm · RichardErkhov
Params457M
Context2K
Q4_K_M0.3 GB
GGUF
LL
llm compiler 7b
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
SP
speakleash Bielik 7B Instruct v0.1
Speakleash · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
TW
TwinLlama 3.1 8B
Twinllama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
XX
T5 V1_1 Xxl
Xxl · chatpig
Params4.76B
Context512
Q4_K_M2.9 GB
Coding

Other quants

Keep browsing