Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiniCPM5 1B
MiniCPM · RemySkye
Params1.08B
Context128K
Q4_K_M0.7 GB
Tool use
CE
Celeste 12B V1.6
Celeste · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TA
TableLLM 7b
Tablellm · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Reasoning
LL
Llama 3 Meerkat 70b v1.0
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen3 4B Thinking 2507 Heretic
Qwen · ZuzeTt
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
LL
LLaMA2 13B TiefighterLR
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TI
TinySlime 1.1B Chat v1.0
Tinyslime · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama 3 Peach Instruct 4x8B MoE
Llama · RDson
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
ZI
Zion_Alpha
Zion · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SK
SkyReels V3 14B
Skyreels · vantagewithai
Params18.9B
Context—
Q4_K_M10.1 GB
GGUF
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
GL
AutoGLM-Phone-9B-Multilingual
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
Vision
AP
Apriel-1.5-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
Reasoning
HE
Hexoteric 7B imatrix
Hexoteric · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 7b r
Xlam · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
EV
L3 Evil Stheno v3.2 8B
Evil · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct function calling
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
GE
lemon mint gemma ko 7b instruct v0.71
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
wassimm Llama 3.1 8B psycology w 6k data
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SE
SeaLLM 7B v2.5
Seallm · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
QW
Qwen3-TTS-12Hz-1.7B-Base
Qwen · FILM6912
Params3.1B
Context—
Smallest1.7 GB
GGUF
MI
jisukim8873 mistral 7B alpaca 1 epoch
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Bielik 11B v2.3 Instruct
Bielik · QuantFactory
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
CO
Yi Coder 9B Chat
Coder · QuantFactory
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
TH
THaLLE 0.1 7B Fa
Thalle · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
llama-3-typhoon-v1.5-8b-instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
NU
NuminiLlama 3.1 8B
Numinillama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
Nemotron Research Reasoning Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use

Other quants

Keep browsing