GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
QW
Jeff 1.1 Qwen 27B
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Jeff 1.1 Qwen 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
undi95_mistral-11b-cc-air-rp
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
AY
aya expanse 8b
Aya · QuantFactory
Params8.03B
Context8K
Q4_K_M5.1 GB
HE
Hermyale Stack 90B
Hermyale · mradermacher
Params91.9B
Context128K
Smallest19.8 GB
LL
PsyCoPref Llama3 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RO
rogue enchantress 32k 7B i1
Rogue · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
VE
vev 4b Q4 K M
Vev · SuperPauly
Params4.21B
Context256K
Q4_K_M2.7 GB
ST
Starling LM 11B Alpha
Starling · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
TI
Tiny Aya Water
Tiny · CohereLabs
Params3.35B
Context488K
Q4_K_M2.1 GB
MI
pulsarai_slimopenorca-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
OU
OuteTTS 0.2 500M
Outetts · second-state
Params499M
Context32K
Q4_K_M0.4 GB
UL
Ultra Instruct 12B
Ultra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
PE
PersianLLaMA 13B Instruct
Persianllama · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.1 GB
LL
Llama 3 Nephilim v3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
IA
Iambe RP DARE 20B DENSE
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
MI
K2S3 Mistral 7b v1.2
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
HE
Heart Stolen 8B Model Stock i1
Heart · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
YA
Yarrow Forecast
Yarrow · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
HE
Hemmingway 1 Heretic MTP V3 Final
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
NO
Noromaid 13B v0.1.1
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
novel humanize 4b
Qwen · tinyopsec
Params4.02B
Context40K
Q4_K_M2.5 GB
MI
go bruins v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airoboros 7b Gpt4 1.4.1 Qlora
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
OP
OpenMia Indo Engineering 7b
Openmia · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
MI
K2S3 Mistral 7b v1.0
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
QW
VLAA Thinker Qwen2.5VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
NM
NMTOB 7B i1
Nmtob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Heart Stolen 8B Model Stock
Heart · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB