GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
KO
kyujinpy Kosy Platypus2 13B
Kosy · tensorblock
Params13B
Context2K
Smallest4.9 GB
MP
mpt 30b chat q8
Mpt · quarterturn
Params30B
Context8K
Smallest31.8 GB
CA
Cartinoe5930 original KoRAE 13b
Cartinoe · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
CA
Cartinoe5930 original KoRAE 13b 3ep
Cartinoe · RichardErkhov
Params13.2B
Context2K
Smallest4.9 GB
LN
LN ko2ja 14B v0.1
mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
PA
Pasa 7b Crawler
Pasa · sakura1225
Params7.62B
Context32K
Q4_K_M4.7 GB
SQ
sqlcoder 7b 2
Sqlcoder · omeryentur
Params6.74B
Context16K
Smallest4.8 GB
CH
Chemlm
Chemlm · MaspnAI
Params271M
Context2K
Smallest0.3 GB
CH
F16
Chambette · chambette
Params8.29B
Context8K
Smallest16.6 GB
CH
chroma debug
Chroma · da28t954
Params8.9B
Context—
Smallest9.3 GB
ME
Merged
Merged · RichardErkhov
Params13.2B
Context2K
Smallest4.9 GB
DA
DataVortexS 10.7B v0.3
Datavortexs · RichardErkhov
Params10.9B
Context4K
Smallest4.1 GB
OO
OOM 13B 02
Oom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GI
giprime OOM 13B 02
Giprime · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GI
giprime OOM 13B 01
Giprime · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
MI
Ko Mixtral MoE 7Bx2
Mistral · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
LL
llama3 koen 8b sft v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
DR
DROID_MiniAI_C
Droid · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
SA
Sakura 7B LNovel v0.9
Sakura · Ae86-6
Params7.72B
Context32K
Q4_K_M4.9 GB
QW
triagellm qwen3 1.7b
Qwen · ProToni
Params1.72B
Context40K
Q4_K_M1.1 GB