GGUF models: cc-by-nc-nd-4.0 license
334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 8 i1
Magpantheonsel · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
UN
Uncensored Jordan 13B
Uncensored · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AT
Athena-70B-L3
Athena · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
JS
JSL MedLlama 3 70B v1.0 i1
Jsl · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MA
MATE 3B
Mate · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
VE
delcos_velara
Velara · TheBloke
Params11.4B
Context32K
Q4_K_M6.8 GB
JS
JSL MedMNX 7B
Jsl · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2 Code Ft
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
JSL Med Sft Llama 3 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
JA
JAX XORTRON
Jax · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
JS
JSL MedLlama 3 8B v1.0
Jsl · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
JS
JSL MedMNX 7B
Jsl · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
AG
Aguie chat proto i1
Aguie · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
SL
SlimOrca 13B
Slimorca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
JA
JAX XORTRON
Jax · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
UN
Uncensored Jordan 33B
Uncensored · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
BI
BioMistral MedMNX i1
Biomistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
BA
Bayan 15B
Bayan · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GL
Incoai GLM 5.3 Flash DFlash2
GLM · vcruz305
Params1.17B
Context1024K
Smallest2.4 GB
QW
Qwenwify 32B v4 i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
BL
BlackSheep RP 8B i1
Blacksheep · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
MS MagpantheonselRP 22B 15 i1
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
LL
xFinder Llama38It
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Delcos airoboros mistral2.2 Starling 11b
Mistral · RichardErkhov
Params11.4B
Context32K
Q4_K_M6.8 GB
TR
Trrapi 16b
Trrapi · mradermacher
Params18.8B
Context32K
Q4_K_M11.3 GB
SO
M SOLAR 10.7B v1.4
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
ME
MemPrivacy 1.7B SFT
Memprivacy · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
UN
Uncensored Jordan 13B
Uncensored · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MI
Starling LM 11B alpha Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
UNA TheBeagle 7b v1
Una · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB