GGUF models: cc-by-nc-nd-4.0 license

334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
L3MaidRPKraiKei V1.65 8B i1
Maidrpkraikei · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B Instruct v0.2 Code Ft
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
PI
Piros Toll
Piros · Flashtond22
Params88M
Context1K
Q4_K_M0.1 GB
GGUF
TI
TITPOP 200M dev
Titpop · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
MA
T.macrophylla 3.1
Macrophylla · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwenwify2.5 32B v3.98
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
ME
MemPrivacy 4B RL
Memprivacy · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
ReasoningTool use
GE
CanadaDiver_KiCad Gemma4 E2B v3 Merged
Gemma · CanadaDiver
Params4.65B
Context128K
Smallest5.0 GB
ReasoningTool use
LL
johnsnowlabs/JSL-Med-Sft-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
AuriAetherwiing/MN-12B-Starcannon-v2
Starcannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
XV
xVerify 8B I
Xverify · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
mobidic solar 10b platypus lora
Mobidic · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
M SOLAR 10.7B v1.4 Dpo
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PY
Python Code 33B
Python · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
Coding
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 8
Magpantheonsel · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
GR
granite tidy
Granite · ddydyss
Params—
Context—
Smallest0.1 GB
GGUF
VA
Vachana v2 Tts
Vachana · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
UN
Ajibawa 2023 Uncensored Jordan 7B
Uncensored · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
SO
Megastudyedu M SOLAR 10.7B v1.3 Dpo
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
MA
MS MagpantheonselRP 22B 12.995
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
SC
scarlett 33b i1
Scarlett · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
MA
MS MagpantheonselRP 22B 12.22 Fictional
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
GE
KiCad Gemma4 E2B v2
Gemma · CanadaDiver
Params4.65B
Context128K
Smallest5.0 GB
ReasoningTool use
SY
SymbiHot L3 8B Rewinded
Symbihot · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
opus v1.2 llama 3 8b
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ON
OncoReasoning 0426
Oncoreasoning · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
MO
ME MOE 7Bx2_test
Moe · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
JS
JSL MedMNX 7B
Jsl · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing