GGUF models: cc-by-nc-nd-4.0 license

334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
VE
Velara
Velara · tensorblock
Params11.4B
Context32K
Smallest4.2 GB
GGUF
QW
Qwenwify 32B v3 i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
SO
M SOLAR 10.7B v1.4 Dpo
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CR
Cran-May/Test2_SLIDE
Cran · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
JSL Med Sft Llama 3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SH
Shi Ci_v3 Robin
Shi · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MA
L3MaidRPKraiKei V1.65 8B
Maidrpkraikei · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
MS MagpantheonselRP 22B 13.0
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MA
MS Magpantheonsel lark v4x1.6.2 Cydonia vXXX 22B 5 i1
Magpantheonsel · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
LL
Llam Romania 3.1f 8B V1.12 sentient i1
Llam · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
EleMo V1
Mistral · Earlychildhoodeducation
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
BI
BioMistral MedMNX
Biomistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
EQ
EQMaven
Eqmaven · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AG
Aguie chat v0.1
Aguie · mradermacher
Params13.3B
Context2K
Q4_K_M8.0 GB
GGUF
MA
MS MagpantheonselRP 22B 12.2 Fictional
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
PA
PantheraMax L3 RP TestProbe 4 4x8B
Pantheramax · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
Roleplay
HE
MS Hempantheonsel Mull v5x1.8RP Cydonia vXXX 24B 12
Hempantheonsel · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral magnum_X_Cydonia v1.3
Mistral · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
PR
Prometheus 1.8
Prometheus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llam Romania 3.1f 8B V1.12 sentient
Llam · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PY
Vandijklab Pythia 160m C2S
Pythia · tensorblock
Params162M
Context9K
Smallest0.1 GB
GGUF
JS
JSL MedMNX 7B
Jsl · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
PE
Perpicon Experimental 3.1
Perpicon · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AG
Aguie chat proto
Aguie · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
PY
Ajibawa 2023 Python Code 33B
Python · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
Coding
MA
MS MagpantheonselRP 22B 12.1 Writing
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
RI
ME 7B v1.0
Richarderkhov · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JO
johnsnowlabs JSL MedMNX 7B
Johnsnowlabs · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
Mistral Pygmalion 7b
Mistral · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
GO
RA God Law Of One
God · teyler
Params3.21B
Context128K
Smallest6.4 GB
Tool use

Keep browsing