GGUF models: cc-by-nc-nd-4.0 license
334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.
MA
L3MaidRPKraiKei V1.65 8B i1
Maidrpkraikei · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral 7B Instruct v0.2 Code Ft
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PI
Piros Toll
Piros · Flashtond22
Params88M
Context1K
Q4_K_M0.1 GB
TI
TITPOP 200M dev
Titpop · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MA
T.macrophylla 3.1
Macrophylla · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwenwify2.5 32B v3.98
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
ME
MemPrivacy 4B RL
Memprivacy · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
GE
CanadaDiver_KiCad Gemma4 E2B v3 Merged
Gemma · CanadaDiver
Params4.65B
Context128K
Smallest5.0 GB
LL
johnsnowlabs/JSL-Med-Sft-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
AuriAetherwiing/MN-12B-Starcannon-v2
Starcannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
XV
xVerify 8B I
Xverify · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
mobidic solar 10b platypus lora
Mobidic · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
M SOLAR 10.7B v1.4 Dpo
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PY
Python Code 33B
Python · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
MA
MS Magpantheonsel lark v4x1.6.2RP Cydonia vXXX 22B 8
Magpantheonsel · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
GR
granite tidy
Granite · ddydyss
Params—
Context—
Smallest0.1 GB
VA
Vachana v2 Tts
Vachana · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
UN
Ajibawa 2023 Uncensored Jordan 7B
Uncensored · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
SO
Megastudyedu M SOLAR 10.7B v1.3 Dpo
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
MA
MS MagpantheonselRP 22B 12.995
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
SC
scarlett 33b i1
Scarlett · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
MA
MS MagpantheonselRP 22B 12.22 Fictional
Magpantheonselrp · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
GE
KiCad Gemma4 E2B v2
Gemma · CanadaDiver
Params4.65B
Context128K
Smallest5.0 GB
SY
SymbiHot L3 8B Rewinded
Symbihot · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
opus v1.2 llama 3 8b
Llama · LoneStriker
Params8.03B
Context8K
Q4_K_M4.9 GB
ON
OncoReasoning 0426
Oncoreasoning · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
MO
ME MOE 7Bx2_test
Moe · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
JS
JSL MedMNX 7B
Jsl · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB