GGUF models: cc-by-nc-nd-4.0 license
334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.
VE
Velara
Velara · tensorblock
Params11.4B
Context32K
Smallest4.2 GB
QW
Qwenwify 32B v3 i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
SO
M SOLAR 10.7B v1.4 Dpo
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
CR
Cran-May/Test2_SLIDE
Cran · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
JSL Med Sft Llama 3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SH
Shi Ci_v3 Robin
Shi · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
L3MaidRPKraiKei V1.65 8B
Maidrpkraikei · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
MS MagpantheonselRP 22B 13.0
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
MA
MS Magpantheonsel lark v4x1.6.2 Cydonia vXXX 22B 5 i1
Magpantheonsel · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
LL
Llam Romania 3.1f 8B V1.12 sentient i1
Llam · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
EleMo V1
Mistral · Earlychildhoodeducation
Params23.6B
Context32K
Q4_K_M14.3 GB
BI
BioMistral MedMNX
Biomistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
EQ
EQMaven
Eqmaven · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AG
Aguie chat v0.1
Aguie · mradermacher
Params13.3B
Context2K
Q4_K_M8.0 GB
MA
MS MagpantheonselRP 22B 12.2 Fictional
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
PA
PantheraMax L3 RP TestProbe 4 4x8B
Pantheramax · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
HE
MS Hempantheonsel Mull v5x1.8RP Cydonia vXXX 24B 12
Hempantheonsel · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral magnum_X_Cydonia v1.3
Mistral · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
PR
Prometheus 1.8
Prometheus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llam Romania 3.1f 8B V1.12 sentient
Llam · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PY
Vandijklab Pythia 160m C2S
Pythia · tensorblock
Params162M
Context9K
Smallest0.1 GB
JS
JSL MedMNX 7B
Jsl · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
PE
Perpicon Experimental 3.1
Perpicon · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
AG
Aguie chat proto
Aguie · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
PY
Ajibawa 2023 Python Code 33B
Python · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
MA
MS MagpantheonselRP 22B 12.1 Writing
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
RI
ME 7B v1.0
Richarderkhov · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
JO
johnsnowlabs JSL MedMNX 7B
Johnsnowlabs · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
Mistral Pygmalion 7b
Mistral · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GO
RA God Law Of One
God · teyler
Params3.21B
Context128K
Smallest6.4 GB