Q3_K GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 15171 models have a Q3_K file. Sizes run from 1M to 5632B parameters. The longest trained context is 102400K tokens.
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · RusteddDDD
Params7.5B
Context128K
Q4_K_M5.3 GB
LL
meta llama Llama 2 7b hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
JI
jieliu Storm 7B
Jieliu · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GI
Gille StrangeMerges 21 7B slerp
Gille · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
Finance Chat
Finance · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
CodeLlama-70b-Python-hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 1.0
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Nephilim v2.1 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GO
google shieldgemma 9b
Google · RichardErkhov
Params9.24B
Context8K
Q4_K_M3.1 GB
QW
Qwen3.5 27B Opus Reasoning v2 Abliterated EvoPress
Qwen · Flakily6416
Params26.9B
Context256K
Smallest10.7 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · steampunque
Params108B
Context10240K
Smallest42.8 GB
GR
Granite 3b Code Instruct 2k
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
MI
macadeliccc Mistral 7B v0.2 OpenHermes
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 Ataraxy Gemmasutra 9B slerp
Gemma · AI-Art-Collab
Params9.24B
Context8K
Q4_K_M5.8 GB
FI
finance chat
Finance · andrijdavid
Params6.74B
Context4K
Q4_K_M4.1 GB
MA
Magic-Dolphin-7b
Magic · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
chlee10 T3Q Merge Mistral7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Vegybin11 Llama 3.1 8B bnb 4bit python
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
sabia-7b
Sabia · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
SA
saishf Multi Verse RP 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
bugdaryan Code Llama 2 13B instruct text2sql
Llama · RichardErkhov
Params3.8B
Context—
Q4_K_M0.0 GB
PH
microsoft phi 1 5
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
AP
Apriel 1.6 15b Thinker
Apriel · eaddario
Params14.4B
Context256K
Q4_K_M8.8 GB
CH
chinese alpaca 2 13b
Chinese · shaowenchen
Params13.3B
Context4K
Smallest5.6 GB
SA
Salamandra 2b Instruct
Salamandra · RichardErkhov
Params2.25B
Context8K
Q4_K_M1.5 GB
QW
Qwen Image 2512
Qwen · Civitai
Params20.4B
Context—
Smallest6.7 GB
CA
CalliopeDS L2 13B
Calliopeds · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
VI
vibevoice-7b
Vibevoice · cstr
Params9.34B
Context—
Smallest6.2 GB
MI
eldogbbhed NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AM
amitk23 autonomous learner 1
Amitk · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB