GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Jeff 1.1 Qwen 27B
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
QW
Jeff 1.1 Qwen 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
MI
undi95_mistral-11b-cc-air-rp
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
AY
aya expanse 8b
Aya · QuantFactory
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
HE
Hermyale Stack 90B
Hermyale · mradermacher
Params91.9B
Context128K
Smallest19.8 GB
GGUF
LL
PsyCoPref Llama3 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RO
rogue enchantress 32k 7B i1
Rogue · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VE
vev 4b Q4 K M
Vev · SuperPauly
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
ST
Starling LM 11B Alpha
Starling · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
TI
Tiny Aya Water
Tiny · CohereLabs
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
MI
pulsarai_slimopenorca-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OU
OuteTTS 0.2 500M
Outetts · second-state
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
UL
Ultra Instruct 12B
Ultra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PE
PersianLLaMA 13B Instruct
Persianllama · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.1 GB
GGUF
LL
Llama 3 Nephilim v3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IA
Iambe RP DARE 20B DENSE
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
MI
K2S3 Mistral 7b v1.2
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
HE
Heart Stolen 8B Model Stock i1
Heart · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
YA
Yarrow Forecast
Yarrow · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
HE
Hemmingway 1 Heretic MTP V3 Final
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
NO
Noromaid 13B v0.1.1
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
novel humanize 4b
Qwen · tinyopsec
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
MI
go bruins v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
AI
Airoboros 7b Gpt4 1.4.1 Qlora
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
OP
OpenMia Indo Engineering 7b
Openmia · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
MI
K2S3 Mistral 7b v1.0
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
QW
VLAA Thinker Qwen2.5VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningTool use
NM
NMTOB 7B i1
Nmtob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Heart Stolen 8B Model Stock
Heart · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing