GGUF models: cc-by-nc-nd-4.0 license
334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.
CO
cookinai Bald Eagle 7B
Cookinai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
JS
johnsnowlabs/JSL-MedLlama-3-8B-v2.0
Jsl · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
MS MagpantheonselRP 22B 12.1 Writing i1
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
UN
Uncensored Jordan 13B
Uncensored · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
KE
Keiana L3 Test6.2 8B 18 i1
Keiana · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
AP
APMIC caigun lora model 34B v2
Apmic · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
SO
M SOLAR 10.7B v1.4 Dpo
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
UNA SOLAR 10.7B Instruct v1.0
Solar · fblgit
Params10.7B
Context4K
Smallest7.6 GB
JO
johnsnowlabs JSL MedPhi2 2.7B
Johnsnowlabs · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
LL
opus v1.2 llama 3 8b
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
JS
JSL MedMNX 7B
Jsl · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
BA
cookinai/Bald-Eagle-7B
Bald · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
megastudyedu/M-SOLAR-10.7B-v1.3-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
OP
Opus v1 34b
Opus · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
xFinder Qwen1505
Qwen · mradermacher
Params620M
Context32K
Q4_K_M0.4 GB
SO
M SOLAR 10.7B v1.4
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
Mistral magnum_X_Cydonia v1.3
Mistral · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
PY
C2S Pythia 410m Diverse Single And Multi Cell Tasks
Pythia · RichardErkhov
Params405M
Context8K
Q4_K_M0.3 GB
HE
MS Hempantheonsel Mull v5x1.8RP Cydonia vXXX 24B 12 i1
Hempantheonsel · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
SO
megastudyedu/M-SOLAR-10.7B-v1.3
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
CO
Code 13B
Code · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
JSL Med Sft Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
BL
.\BlackSheep Pi
Blacksheep · mradermacher
Params3.14B
Context16K
Q4_K_M1.9 GB
NA
nart 7b
Nart · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
Qwenwify 32B v4
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
MI
ME MISTRAL 7B v1.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MemPrivacy 4B SFT
Memprivacy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
AP
APMIC caigun lora model 34B v3
Apmic · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
MA
Mavens 2
Mavens · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 6 i1
Magpantheonsel · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB