GGUF models: cc-by-nc-nd-4.0 license
334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.
TU
TurdusNitrous 7B V1
Turdusnitrous · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
SOLAR 2x10.7b truthy dpo i1
Solar · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
LL
JSL-MedLlama-3-8B-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwenwify2.5 32B v3.98 i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
ME
MemPrivacy 1.7B RL
Memprivacy · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
CO
Code 290k 13B
Code · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
DR
dreamgen opus v1.2 70b
Dreamgen · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
JS
JSL MedMNX 7B
Jsl · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
opus v1.2 70b i1
Opus · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
SL
SlimOrca 13B
Slimorca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
MN 12B Starcannon v2
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
UN
fblgit/UNA-POLAR-10.7B-InstructMath-v1
Una · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
CA
ajibawa 2023 carl 33b
Carl · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
MA
MS MagpantheonselRP 22B 12.2 Fictional i1
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
LL
opus-v1.2-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
TH
TheSpissInWestLake 7B V1
Thespissinwestlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
M SOLAR 10.7B v1.3 Dpo
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
JS
johnsnowlabs/JSL-MedLlama-3-8B-v1.0
Jsl · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
DY
DylanDeep Core 8B
Dylandeep · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
UNA TheBeagle 7b v1
Una · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Bayan 15B
Bayan · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
SO
megastudyedu/M-SOLAR-10.7B-v1.4
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
JS
JSL MedLlama 3 8B v2.0
Jsl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
FB
fblgit UNA POLAR 10.7B InstructMath v2
Fblgit · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
opus v1.4 70b llama3
Llama · dreamgen
Params70.6B
Context8K
Q4_K_M42.5 GB
YU
Yuna Ai V4
Yuna · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
AN
AnFeng_v3_Avocet
Anfeng · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
UN
fblgit/UNA-POLAR-10.7B-InstructMath-v2
Una · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
UN
fblgit/UNA-SOLAR-10.7B-Instruct-v1.0
Una · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MA
MATE 3B
Mate · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB