GGUF models: cc-by-nc-nd-4.0 license

334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 1.5B Auto FunctionCaller
Qwen · sinatras
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
ST
MN 12B Starcannon v2 i1
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
JS
JSL MedLlama 3 8B v2.0 i1
Jsl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DO
Ursidae-11b-Mini
Dolus · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
Reasoning
UN
ajibawa-2023_uncensored-frank-7b
Uncensored · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
DY
DylanDeep Core 8B
Dylandeep · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
JA
JAX XORTRON
Jax · darkc0de
Params27.3B
Context256K
Smallest19.5 GB
ReasoningTool use
GU
Gureum_1.0_neo
Gureum · mradermacher
Params2.31B
Context32K
Q4_K_M1.4 GB
GGUF
DO
Dolus 14b Mini i1
Dolus · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
Reasoning
MA
L3MaidRPKraiKei-V1.66-8B-2
Maidrpkraikei · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
XORTRON XPRT
Qwen · darkc0de
Params34.7B
Context256K
Smallest24.7 GB
ReasoningTool useVision
GE
Gemma 4 31B Animus V17.0
Gemma · Darkhn-Quants-4
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GL
Glm53 Dflash2 Draft
GLM · Anbeeld
Params2.46B
Context1024K
Q4_K_M1.4 GB
ReasoningTool use
PY
Python Code 13B
Python · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Coding
UN
UNA POLAR 10.7B InstructMath v2
Una · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
M SOLAR 10.7B v1.4
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PY
Python Code 33B
Python · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
Coding
UN
UNA TheBeagle 7b v1
Una · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JS
JSL MedLlama 3 70B v1.0
Jsl · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
CO
Code 13B
Code · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Coding
DO
Dolus 14b Mini
Dolus · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
Reasoning
JS
JSL MedLlama 3 8B v1.0
Jsl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
JSL-MedLlama-3-8B-v2.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PY
Python Code 13B
Python · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Coding
UN
Uncensored Jordan 33B i1
Uncensored · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
GGUF
OP
opus v1.2 70b
Opus · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
AJ
ajibawa-2023_uncensored-frank-33b
Ajibawa · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
XV
xVerify 0.5B I
Xverify · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Reasoning
XV
xVerify 3B Ia
Xverify · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Reasoning
MA
MS MagpantheonselRP 22B 12.22 Fictional i1
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use

Keep browsing