GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
KO
kyujinpy Kosy Platypus2 13B
Kosy · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
MP
mpt 30b chat q8
Mpt · quarterturn
Params30B
Context8K
Smallest31.8 GB
GGUF
CA
Cartinoe5930 original KoRAE 13b
Cartinoe · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
CA
Cartinoe5930 original KoRAE 13b 3ep
Cartinoe · RichardErkhov
Params13.2B
Context2K
Smallest4.9 GB
GGUF
LN
LN ko2ja 14B v0.1
mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
PA
Pasa 7b Crawler
Pasa · sakura1225
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
SQ
sqlcoder 7b 2
Sqlcoder · omeryentur
Params6.74B
Context16K
Smallest4.8 GB
Coding
CH
Chemlm
Chemlm · MaspnAI
Params271M
Context2K
Smallest0.3 GB
GGUF
CH
F16
Chambette · chambette
Params8.29B
Context8K
Smallest16.6 GB
GGUF
CH
chroma debug
Chroma · da28t954
Params8.9B
Context—
Smallest9.3 GB
GGUF
ME
Merged
Merged · RichardErkhov
Params13.2B
Context2K
Smallest4.9 GB
GGUF
DA
DataVortexS 10.7B v0.3
Datavortexs · RichardErkhov
Params10.9B
Context4K
Smallest4.1 GB
GGUF
OO
OOM 13B 02
Oom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
GI
giprime OOM 13B 02
Giprime · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
GI
giprime OOM 13B 01
Giprime · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
MI
Ko Mixtral MoE 7Bx2
Mistral · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
GGUF
LL
llama3 koen 8b sft v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
DR
DROID_MiniAI_C
Droid · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SA
Sakura 7B LNovel v0.9
Sakura · Ae86-6
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
QW
triagellm qwen3 1.7b
Qwen · ProToni
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use

Keep browsing