GGUF models: cc-by-nc-nd-4.0 license

334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TU
TurdusNitrous 7B V1
Turdusnitrous · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
SOLAR 2x10.7b truthy dpo i1
Solar · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
GGUF
LL
JSL-MedLlama-3-8B-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwenwify2.5 32B v3.98 i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
ME
MemPrivacy 1.7B RL
Memprivacy · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
CO
Code 290k 13B
Code · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
Coding
DR
dreamgen opus v1.2 70b
Dreamgen · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
JS
JSL MedMNX 7B
Jsl · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
opus v1.2 70b i1
Opus · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
SL
SlimOrca 13B
Slimorca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
MN 12B Starcannon v2
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
UN
fblgit/UNA-POLAR-10.7B-InstructMath-v1
Una · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CA
ajibawa 2023 carl 33b
Carl · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
GGUF
MA
MS MagpantheonselRP 22B 12.2 Fictional i1
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
LL
opus-v1.2-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
TheSpissInWestLake 7B V1
Thespissinwestlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
M SOLAR 10.7B v1.3 Dpo
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
JS
johnsnowlabs/JSL-MedLlama-3-8B-v1.0
Jsl · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DY
DylanDeep Core 8B
Dylandeep · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
UN
UNA TheBeagle 7b v1
Una · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
Bayan 15B
Bayan · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
SO
megastudyedu/M-SOLAR-10.7B-v1.4
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
JS
JSL MedLlama 3 8B v2.0
Jsl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FB
fblgit UNA POLAR 10.7B InstructMath v2
Fblgit · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
opus v1.4 70b llama3
Llama · dreamgen
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
YU
Yuna Ai V4
Yuna · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
AN
AnFeng_v3_Avocet
Anfeng · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
UN
fblgit/UNA-POLAR-10.7B-InstructMath-v2
Una · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
UN
fblgit/UNA-SOLAR-10.7B-Instruct-v1.0
Una · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MA
MATE 3B
Mate · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use

Keep browsing