Q5_1 GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 17701 models have a Q5_1 file. Sizes run from 1M to 1030B parameters. The longest trained context is 4194304K tokens.
AM
amitk23 autonomous learner 1
Amitk · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama-3.3-70B-Instruct
Llama · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
LL
MLP KTLim llama 3 Korean Bllossom 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
swap uniba LLaMAntino 2 chat 13b hf ITA
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MI
MiraTTS
Miratts · Mungert
Params507M
Context32K
Q4_K_M0.4 GB
IN
InternVL3-8B
Internvl · Mungert
Params7.61B
Context32K
Q4_K_M4.8 GB
LL
Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
meta llama CodeLlama 7b Python hf
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Meraj Mini
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
FA
Falcon H1 Tiny R 0.6B
Falcon · tiiuae
Params622M
Context256K
Q4_K_M0.4 GB
GE
gemma-2-9b-it
Gemma · SanctumAI
Params9.24B
Context8K
Q4_K_M5.8 GB
KR
krishnachaitanya5555 fitness chatbot model
Krishnachaitanya · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
MI
Vikhr Nemo 12B Instruct R 21 09 24
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3 8B OpenHermes 2.5 1M
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
SM
SmolLlama-1.5B-Sorted
Smolllama · RichardErkhov
Params1.5B
Context2K
Q4_K_M0.9 GB
QW
Qwen3 TTS 12Hz 0.6B Base
Qwen · FILM6912
Params2B
Context—
Smallest1.3 GB
NI
Astral Fusion Neural Happy L3.1 8B
Nihappy · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
deepseek coder 7b instruct
DeepSeek · jtrancas
Params6.74B
Context16K
Smallest2.8 GB
TI
TIPO 500M
Tipo · RichardErkhov
Params508M
Context2K
Q4_K_M0.3 GB
QW
TableGPT2 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
nbeerbower Stella mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
gemma-2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GR
Granite 3.1 Earthen v0.3 3B A800M
Granite · PJMixers-Dev
Params3.3B
Context128K
Q4_K_M2.0 GB
IN
AlchemistCoder L 7B
InternLM · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Nanonets-OCR-s
Qwen · Mungert
Params3.09B
Context125K
Q4_K_M1.9 GB
LL
Dolphin 3.0 Llama 3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
SD3.5 Large Turbo GGUF mixed sdcpp
Stable · stduhpf
Params8.23B
Context—
Smallest4.7 GB
QW
Qwen3 32B
Qwen · duyntnet
Params32.8B
Context40K
Q4_K_M19.8 GB
LL
Llama3 8B Chinese Chat
Llama · pravdin
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
OneSQL v0.2 Qwen 3B
Qwen · onekq-ai
Params3.09B
Context32K
Q4_K_M1.9 GB