GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
SA
saishf Neural SOVLish Devil 8B L3
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
FI
Fish 8x7B i1
Fish · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
AR
PhysicsWallah/Aryabhata-1.0
Aryabhata · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
MixtralOrochi8x7B
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
NO
Nous Lotus 10.7B
Nous · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
L3 Solana 8B v1
Solana · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
IT
ITT Yi Ko 6B v4.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
YI
Fook-Yi-34B-32K-v1
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
LL
maldv badger lambda llama 3 8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
AR
Aratako Oumuamua 7b RP
Aratako · RichardErkhov
Params7.33B
Context32K
Q4_K_M4.4 GB
CA
CarbonVillain 10.7B v2
Carbonvillain · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
NE
Nemotron Research GooseReason 4B Instruct Heretic v2
Nemotron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ZE
zephyr-wizard-kuno-royale-BF16-merge-7B
Zephyr · grimjim
Params7.24B
Context32K
Smallest4.4 GB
TE
Byungchae/k2s3_test_0001
Test · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
MI
MN 12B Mimicore Nocturne
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CL
CleverGirl 20b Blended v1.1 DARE
Clevergirl · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
MO
MonarchLake 7B i1
Monarchlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 8B EGO
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
StartLux Decision v1 0.8B Q4 K M
Startlux · startlux-models
Params752M
Context256K
Q4_K_M0.5 GB
NO
Noromaid 13B 0.4 DPO
Noromaid · NeverSleep
Params13B
Context4K
Q4_K_M7.9 GB
MI
Dionysus Mistral M3 v6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CG
cgato L3 TheSpice 8b v0.8.3
Cgato · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
DO
Dolphin Xgen RL
Dolphin · mradermacher
Params10.7B
Context256K
Q4_K_M6.5 GB
SP
Spaetzle v85 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
NeverSleep Noromaid 13b v0.2
Neversleep · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
ML
MLewdBoros L2 13B i1
Mlewdboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
CO
ColdBrew Nemo 12B Arcane Fusion Combined
Coldbrew · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TH
L3 TheGreenLion 8b Experimental i1
Thegreenlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SO
Changgil/K2S3-SOLAR-11b-v4.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
NL
nllb 200 distilled 600M malaga
Nllb · rleo
Params600M
Context—
Q4_K_M0.5 GB