Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
GO
Gonzo Code 7B
Gonzo · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Sparse Llama 3.1 8B 2of4
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3-16B-A3B
Qwen · Mungert
Params16B
Context40K
Q4_K_M10.0 GB
PH
calme 2.3 phi3 4b
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
BI
Biomistral Calme Instruct 7b
Biomistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LT
LTX 2.3 DISTILLED
Ltx · FenomAI
Params21B
Context—
Q4_K_M14.2 GB
GE
Gemma 2 2b It
Gemma · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Llama3-ChatQA-1.5-8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
FL
FLUX.1 Fill dev
Flux · gaianet
Params84M
Context—
Smallest0.3 GB
LL
Llama 3 8B Magpie Align SFT v0.1
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 14B sk
Qwen · worstplayer
Params14.8B
Context40K
Q4_K_M9.0 GB
RW
RWKV6 3B Chn UnlimitedRP Mini Chat HF
Rwkv · mzwing
Params3.1B
Context1024K
Q4_K_M1.9 GB
GR
Granite 20b Code Instruct 8k
Granite · RichardErkhov
Params20.1B
Context8K
Q4_K_M12.8 GB
OP
OpenCoder 8B Instruct
Opencoder · QuantFactory
Params7.77B
Context8K
Q4_K_M4.7 GB
LL
Bio Medical Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
NU
NuExtract 2.0 8B
Nuextract · numind
Params7.62B
Context125K
Q4_K_M4.7 GB
NO
LemonadeRP 4.5.3
Noromaid · TheBigBlender
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ft Mistral 7b Instruct v0.2 Sorry Bench 202406
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenOrca-Platypus2-13B
Openorca · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
LL
Meta Llama Guard 2 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GL
Glm 4 9b Chat
GLM · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
LL
Llama 3.2 1B
Llama · duyntnet
Params1.24B
Context128K
Q4_K_M0.8 GB
FA
Falcon 11B
Falcon · QuantFactory
Params11.1B
Context2K
Q4_K_M6.8 GB
LL
Medichat Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
TR
Triangulum 1B
Triangulum · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
GE
saiga gemma2 10b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-v2
Qwen · Mungert
Params9.2B
Context256K
Q4_K_M6.6 GB
GE
lemon mint gemma ko 7b it v0.41
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
DA
Darwin 28B Opus
Darwin · WhoTookMyAmogusNickname
Params26.9B
Context256K
Q4_K_M16.5 GB
NU
Nusantara 4b Indo Chat
Nusantara · ukung
Params3.95B
Context32K
Q4_K_M2.5 GB