GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 LewdPlay 8B Evo
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VI
VieNeu TTS 0.3B Merged
Vieneu · mradermacher
Params294M
Context4K
Q4_K_M0.2 GB
GGUF
NL
nllb 200 distilled 600M
Nllb · acceldium
Params878M
Context1K
Smallest1.8 GB
GGUF
MI
Mistral Darwin 7b v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 Coder 7B 20260218
Qwen · igarin
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
FI
FIBO Scene Analyzer
Fibo · briaai
Params34.7B
Context256K
Q4_K_M21.5 GB
ReasoningVision
FL
TextTopic 14B 0710
Flashtopic · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
KU
Kuwutu 7B CYOA
Kuwutu · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
SH
shadowml WestBeagle 7B
Shadowml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EM
OmniBeagle 7B
Emertonomnibeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GT
GThinker 7B i1
Gthinker · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool use
AY
CohereForAI.aya Expanse 8b
Aya · DevQuasar-3
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
UN
Undi95 MXLewdMini L2 13B
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
Moirai Agent
Moirai · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
HE
Hemmingway 1.5
Hemmingway · Phil2Sat
Params27.3B
Context256K
Smallest12.8 GB
ReasoningTool use
AY
Aya Empati
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · joseshpj
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
FA
FARE 20B
Fare · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
HA
Hala 350M
Hala · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
NY
Nyxene v3 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
XL
xLAM 2 3b Fc R
Xlam · DevQuasar-13
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
TH
Thespis CurtainCall 7b v0.2.2
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Lumimaid 70B v0.1 Alt Heretic
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
AY
aya-23-35B
Aya · mradermacher
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
PA
OGNO 7B
Parrotmogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
kukulemon spiked 9B
Kukulemon · grimjim
Params8.99B
Context8K
Q4_K_M5.4 GB
GGUF
MI
NeuralPivot Mistral 13B
Mistral · mradermacher
Params13.3B
Context8K
Q4_K_M8.0 GB
GGUF
KA
Kakaocorp.Kanana Nano 2.1b Instruct
Kanana · DevQuasar
Params2.09B
Context8K
Q4_K_M1.4 GB
GGUF
AN
Antares 11b v2
Antares · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
EX
Explore LM Ext 7B Math
Explore · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF

Keep browsing