GGUF models: cc-by-nc-nd-4.0 license
334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.
QW
Qwen2.5 1.5B Auto FunctionCaller
Qwen · sinatras
Params1.54B
Context32K
Q4_K_M1.0 GB
ST
MN 12B Starcannon v2 i1
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
JS
JSL MedLlama 3 8B v2.0 i1
Jsl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
DO
Ursidae-11b-Mini
Dolus · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
UN
ajibawa-2023_uncensored-frank-7b
Uncensored · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
DY
DylanDeep Core 8B
Dylandeep · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
JAX XORTRON
Jax · darkc0de
Params27.3B
Context256K
Smallest19.5 GB
GU
Gureum_1.0_neo
Gureum · mradermacher
Params2.31B
Context32K
Q4_K_M1.4 GB
DO
Dolus 14b Mini i1
Dolus · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
MA
L3MaidRPKraiKei-V1.66-8B-2
Maidrpkraikei · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
XORTRON XPRT
Qwen · darkc0de
Params34.7B
Context256K
Smallest24.7 GB
GE
Gemma 4 31B Animus V17.0
Gemma · Darkhn-Quants-4
Params30.7B
Context256K
Q4_K_M18.7 GB
GL
Glm53 Dflash2 Draft
GLM · Anbeeld
Params2.46B
Context1024K
Q4_K_M1.4 GB
PY
Python Code 13B
Python · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
UN
UNA POLAR 10.7B InstructMath v2
Una · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
M SOLAR 10.7B v1.4
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
PY
Python Code 33B
Python · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
UN
UNA TheBeagle 7b v1
Una · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
JS
JSL MedLlama 3 70B v1.0
Jsl · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
CO
Code 13B
Code · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
DO
Dolus 14b Mini
Dolus · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
JS
JSL MedLlama 3 8B v1.0
Jsl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
JSL-MedLlama-3-8B-v2.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
PY
Python Code 13B
Python · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
UN
Uncensored Jordan 33B i1
Uncensored · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
OP
opus v1.2 70b
Opus · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
AJ
ajibawa-2023_uncensored-frank-33b
Ajibawa · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
XV
xVerify 0.5B I
Xverify · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
XV
xVerify 3B Ia
Xverify · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
MA
MS MagpantheonselRP 22B 12.22 Fictional i1
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB