GGUF models: agpl-3.0 license
275 GGUF models listed under the agpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 754B parameters. The longest trained context is 256K tokens.
CO
Control 8B
Control · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GL
GLM 5.1 Abliterated Q5 K M
GLM · arxorry
Params754B
Context198K
Smallest534.3 GB
QW
Prose Rewriter 4b v1.3
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
IG
IGN5
Ign · mintflow
Params9.2B
Context256K
Q4_K_M5.8 GB
PR
Prose Rewriter 1.7b v1.5
Prose · mradermacher
Params2.03B
Context32K
Q4_K_M1.3 GB
QW
Prose Rewriter 4b v1.4
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
UL
Ultra WizardLM 120B v0.1
Ultra · mradermacher
Params120B
Context4K
Smallest44.5 GB
QW
Qwable v1 NVFP4
Qwable · FreedomAISVR
Params35.5B
Context256K
Smallest20.2 GB
SP
ds spicy brew 13b
Spicy · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SO
Virende 8B Instruct
Solphie · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GN
GnX
Gnx · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
QW
Abliterated
Qwen · criscar22
Params3.09B
Context32K
Smallest6.2 GB
QW
Prose Rewriter 1.7b v1.5
Qwen · chartreuse-verte
Params2.03B
Context32K
Q4_K_M1.3 GB
QW
Prose Rewriter 1.7b v1.6
Qwen · chartreuse-verte
Params2.03B
Context32K
Smallest2.2 GB
UL
Ultra Miqu WizardLM 120B v0.1 i1
Ultra · mradermacher
Params120B
Context32K
Smallest25.2 GB
RE
Reflection Chinese 32B
Reflection · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
FR
Fruit VL 3B Instruct
Fruit · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
FE
Epiculous/Fett-uccine-7B
Fett · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
limarp llongma2 8k gguf f16
Limarp · nxnhjrjtbjfzhrovwl
Params13B
Context8K
Smallest26.0 GB
DE
MLMLML
DeepSeek · percyraskova
Params8.19B
Context128K
Q4_K_M5.0 GB
LL
Llama 3.2 3B Appreciation
Llama · eltorio
Params24M
Context—
Smallest0.1 GB
EC
echo
Echo · void0x14
Params752M
Context256K
Q4_K_M0.4 GB
QW
DorsetHeatwaveLLM
Qwen · Kype720184
Params1.72B
Context40K
Q4_K_M1.1 GB
EL
ElaNore3 4B GGUFF
Elanore · N-Bot-Int
Params4.02B
Context40K
Smallest8.1 GB
PU
PULSE 7bv5 Q8 0
Pulse · jbot7984
Params8.1B
Context2K
Smallest8.6 GB
EL
ElaNore3 4B_ADJUSTED_DPO Merged
Elanore · sillykiwi
Params4.02B
Context40K
Q4_K_M2.5 GB
GL
GLM 5.1 Abliterated i1
GLM · mradermacher
Params283M
Context—
Smallest1.1 GB
QW
Prose Rewriter 1.7b v2
Qwen · chartreuse-verte
Params2.03B
Context32K
Smallest2.2 GB
LL
petra-13b-instruct
Llama · llama-anon
Params13B
Context2K
Smallest13.8 GB
QW
Mtron Qwen3 4b Gguf
Qwen · phaseshift-studio
Params14.8B
Context40K
Q4_K_M2.5 GB