GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LL
Llama 3 LewdPlay 8B Evo
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
VI
VieNeu TTS 0.3B Merged
Vieneu · mradermacher
Params294M
Context4K
Q4_K_M0.2 GB
NL
nllb 200 distilled 600M
Nllb · acceldium
Params878M
Context1K
Smallest1.8 GB
MI
Mistral Darwin 7b v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 7B 20260218
Qwen · igarin
Params7.62B
Context32K
Q4_K_M4.7 GB
FI
FIBO Scene Analyzer
Fibo · briaai
Params34.7B
Context256K
Q4_K_M21.5 GB
FL
TextTopic 14B 0710
Flashtopic · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
KU
Kuwutu 7B CYOA
Kuwutu · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
SH
shadowml WestBeagle 7B
Shadowml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
EM
OmniBeagle 7B
Emertonomnibeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GT
GThinker 7B i1
Gthinker · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
AY
CohereForAI.aya Expanse 8b
Aya · DevQuasar-3
Params8.03B
Context8K
Q4_K_M5.1 GB
UN
Undi95 MXLewdMini L2 13B
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MO
Moirai Agent
Moirai · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
HE
Hemmingway 1.5
Hemmingway · Phil2Sat
Params27.3B
Context256K
Smallest12.8 GB
AY
Aya Empati
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · joseshpj
Params8.03B
Context128K
Q4_K_M4.9 GB
FA
FARE 20B
Fare · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
HA
Hala 350M
Hala · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
NY
Nyxene v3 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
XL
xLAM 2 3b Fc R
Xlam · DevQuasar-13
Params3.09B
Context32K
Q4_K_M1.9 GB
TH
Thespis CurtainCall 7b v0.2.2
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Lumimaid 70B v0.1 Alt Heretic
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
AY
aya-23-35B
Aya · mradermacher
Params35B
Context8K
Q4_K_M21.5 GB
PA
OGNO 7B
Parrotmogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
kukulemon spiked 9B
Kukulemon · grimjim
Params8.99B
Context8K
Q4_K_M5.4 GB
MI
NeuralPivot Mistral 13B
Mistral · mradermacher
Params13.3B
Context8K
Q4_K_M8.0 GB
KA
Kakaocorp.Kanana Nano 2.1b Instruct
Kanana · DevQuasar
Params2.09B
Context8K
Q4_K_M1.4 GB
AN
Antares 11b v2
Antares · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
EX
Explore LM Ext 7B Math
Explore · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB