Q5_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15099 models have a Q5_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
MI
chlee10 T3Q Merge Mistral7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Vegybin11 Llama 3.1 8B bnb 4bit python
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
sabia-7b
Sabia · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
SA
saishf Multi Verse RP 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
bugdaryan Code Llama 2 13B instruct text2sql
Llama · RichardErkhov
Params3.8B
Context—
Q4_K_M0.0 GB
PH
microsoft phi 1 5
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
AP
Apriel 1.6 15b Thinker
Apriel · eaddario
Params14.4B
Context256K
Q4_K_M8.8 GB
CH
chinese alpaca 2 13b
Chinese · shaowenchen
Params13.3B
Context4K
Smallest5.6 GB
SA
Salamandra 2b Instruct
Salamandra · RichardErkhov
Params2.25B
Context8K
Q4_K_M1.5 GB
QW
Qwen Image 2512
Qwen · Civitai
Params20.4B
Context—
Smallest6.7 GB
CA
CalliopeDS L2 13B
Calliopeds · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
VI
vibevoice-7b
Vibevoice · cstr
Params9.34B
Context—
Smallest6.2 GB
MI
eldogbbhed NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AM
amitk23 autonomous learner 1
Amitk · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
MLP KTLim llama 3 Korean Bllossom 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
swap uniba LLaMAntino 2 chat 13b hf ITA
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen1.5 1.8B Layla v4
Qwen · l3utterfly
Params1.84B
Context32K
Q4_K_M1.2 GB
LL
meta llama CodeLlama 7b Python hf
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
FA
Falcon H1 Tiny R 0.6B
Falcon · tiiuae
Params622M
Context256K
Q4_K_M0.4 GB
GE
gemma-2-9b-it
Gemma · SanctumAI
Params9.24B
Context8K
Q4_K_M5.8 GB
KR
krishnachaitanya5555 fitness chatbot model
Krishnachaitanya · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
LL
chinese llama 2 1.3b
Llama · hfl
Params1.26B
Context4K
Smallest0.6 GB
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · Unrestricted
Params25.2B
Context256K
Q4_K_M16.8 GB
SM
SmolLlama-1.5B-Sorted
Smolllama · RichardErkhov
Params1.5B
Context2K
Q4_K_M0.9 GB
QW
Qwen3 TTS 12Hz 0.6B Base
Qwen · FILM6912
Params2B
Context—
Smallest1.3 GB
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · DonaldHump
Params25.2B
Context256K
Q4_K_M16.8 GB
CH
chinese alpaca 2 13b 16k
Chinese · hfl
Params13.3B
Context16K
Smallest5.0 GB
DE
deepseek coder 7b instruct
DeepSeek · jtrancas
Params6.74B
Context16K
Smallest2.8 GB
TI
TIPO 500M
Tipo · RichardErkhov
Params508M
Context2K
Q4_K_M0.3 GB
MI
nbeerbower Stella mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB