Q5_1 GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 SynE
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
nbeerbower mistral nemo wissenschaft 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Ae Calem Mistral 7b v0.1
Mistral · RichardErkhov
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3.1-Nemotron-Nano-8B-v1
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
Tool use
GA
garage bAInd Stable Platypus2 13B
Garage · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Vezora Mistral 22B v0.2
Mistral · RichardErkhov
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
GE
Gemma 2b Aps It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · tatsuyaaaaaaa
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
GE
zelk12 recoilme gemma 2 Ataraxy 9B v0.1 t0.25
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NE
nenad1002 quantum research bot v1.0
Nenad · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LO
LongAlpaca 70B
Longalpaca · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
LLaMA2 13B Tiefighter
Llama · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HE
0 hero Matter 0.1 Slim 7B A
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GI
giux78 zefiro 7b beta ITA v0.1
Giux · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Nemotron-Orchestrator-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.4 GB
ReasoningTool use
LF
LFM2.5-24B-A2B
Lfm · Arki05
Params24B
Context128K
Smallest0.0 GB
GGUF
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
GGUF
QW
Qwen3.5 4B
Qwen · tatsuyaaaaaaa
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
GR
granite-20b-code-instruct-r1.1
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
CodingReasoningTool use
QE
QED-Nano
Qed · Mungert
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
MI
WikiHow Mistral Instruct 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5 2B BE
Qwen · taronaeo
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Qwen3.5 9B BE
Qwen · taronaeo
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
GR
Granite 3b Code Base 2k
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
KS
KSIF RPG 128k slerp
Ksif · AlekseiPravdin
Params7.24B
Context128K
Q4_K_M4.4 GB
Roleplay
CH
Chatbench Distilgpt2
Chatbench · ysn-rfd
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
GR
granite-3.0-2b-instruct
Granite · Mungert
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
TU
DR-Tulu-8B
Tulu · Mungert
Params8.19B
Context40K
Q4_K_M5.4 GB
ReasoningTool use
LL
suzume llama 3 8B japanese
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 turbcat instruct 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Other quants

Keep browsing