GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
ME
Merak 7B v3
Merak · Ichsan2895
Params6.74B
Context4K
Q4_K_M4.1 GB
BI
bielik nonsensik v2
Bielik · Sticzu
Params11.2B
Context32K
Q4_K_M6.7 GB
RA
Racka 4B
Racka · elte-nlp
Params4.02B
Context40K
Q4_K_M2.5 GB
OR
orca mini 13b
Orca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GR
KV Ground 4B BaseQw3vl
Ground · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
PA
Pasa 7b Selector
Pasa · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ST
Stablelm Tuned Alpha 7b
Stablelm · mradermacher
Params7.87B
Context4K
Q4_K_M5.1 GB
SA
Kyujinpy Sakura SOLRCA Math Instruct DPO v2
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
CE
Cerebras GPT 111M
mradermacher
Params111M
Context2K
Q4_K_M0.1 GB
JJ
jjourney1125 M SOLAR 10.7B v1.0
Jjourney · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
ST
Stablelm Tuned Alpha 3b
Stablelm · RichardErkhov
Params3.64B
Context4K
Q4_K_M2.3 GB
LL
PlatYi 34B Llama Q v3
Llama · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
BA
t5 base summarization claim extractor
Base · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
DI
M DIE M 10.7B
Die · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
HE
HeackMT5 ZhSum100k
Heackmt · mradermacher
Params582M
Context512
Q4_K_M0.4 GB
QW
Qwen3 Next 80B A3B Thinking GRPO Uncensored
Qwen · puwaer
Params79.7B
Context256K
Q4_K_M48.5 GB
PA
Pasa 7b Crawler
Pasa · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ZO
tlphams/zoyllm-7b-slimorca
Zoyllm · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Sakura SOLAR Instruct
Sakura · andrijdavid
Params10.7B
Context4K
Q4_K_M6.5 GB
MK
MKLLM 7B Translate
Mkllm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama2 13b Dpo v4
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
SE
sea lion 7b instruct research
Sea · mradermacher
Params7.5B
Context2K
Q4_K_M5.0 GB
SA
Sakura 13B LNovel v0.9
Sakura · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
SA
kyujinpy/Sakura-SOLRCA-Instruct-DPO
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
OU
OuteTTS 0.3 1B
Outetts · mradermacher
Params1.19B
Context4K
Q4_K_M0.7 GB
SJ
SJ ko
Sjmoon · sjmoon21
Params76M
Context1K
Smallest0.1 GB
WN
WN VN 14B v0.1
mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Puluming AISquare Instruct llama2 koen 13b v0.9.18
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
PL
Yi Ko Playtus Instruct v0.2
Playtus · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
KO
LN Korean 14B v0.2.1
Korean · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB