GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
saishf Neural SOVLish Devil 8B L3
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FI
Fish 8x7B i1
Fish · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
AR
PhysicsWallah/Aryabhata-1.0
Aryabhata · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
MI
MixtralOrochi8x7B
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
NO
Nous Lotus 10.7B
Nous · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
L3 Solana 8B v1
Solana · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IT
ITT Yi Ko 6B v4.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
YI
Fook-Yi-34B-32K-v1
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
LL
maldv badger lambda llama 3 8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AR
Aratako Oumuamua 7b RP
Aratako · RichardErkhov
Params7.33B
Context32K
Q4_K_M4.4 GB
Roleplay
CA
CarbonVillain 10.7B v2
Carbonvillain · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
NE
Nemotron Research GooseReason 4B Instruct Heretic v2
Nemotron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
CodingReasoningTool use
ZE
zephyr-wizard-kuno-royale-BF16-merge-7B
Zephyr · grimjim
Params7.24B
Context32K
Smallest4.4 GB
GGUF
TE
Byungchae/k2s3_test_0001
Test · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
MN 12B Mimicore Nocturne
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CL
CleverGirl 20b Blended v1.1 DARE
Clevergirl · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
MO
MonarchLake 7B i1
Monarchlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8B EGO
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
StartLux Decision v1 0.8B Q4 K M
Startlux · startlux-models
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
NO
Noromaid 13B 0.4 DPO
Noromaid · NeverSleep
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Dionysus Mistral M3 v6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CG
cgato L3 TheSpice 8b v0.8.3
Cgato · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DO
Dolphin Xgen RL
Dolphin · mradermacher
Params10.7B
Context256K
Q4_K_M6.5 GB
GGUF
SP
Spaetzle v85 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
NeverSleep Noromaid 13b v0.2
Neversleep · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ML
MLewdBoros L2 13B i1
Mlewdboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
ColdBrew Nemo 12B Arcane Fusion Combined
Coldbrew · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TH
L3 TheGreenLion 8b Experimental i1
Thegreenlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SO
Changgil/K2S3-SOLAR-11b-v4.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
NL
nllb 200 distilled 600M malaga
Nllb · rleo
Params600M
Context—
Q4_K_M0.5 GB
GGUF

Keep browsing