GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
TextBase 7B v0.1 Q4 K M
Textbase · cleatherbury
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
WikiQwen 35B A3B
Wikiqwen · ramgpt
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
LL
pub llama 13B v5
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
QW
sakura-14b-qwen2.5-v1.0
Qwen · zye1235357
Params14.8B
Context128K
Smallest12.1 GB
Tool use
LU
Lunar 10.7B
Lunar · jeiku
Params10.7B
Context4K
Smallest4.0 GB
GGUF
FR
Frankenstein MoE En 10.7Bx4
Frankenstein · tensorblock
Params36.1B
Context4K
Smallest13.2 GB
GGUF
AA
Aarushhh yuno 225M python
Aarushhh · RichardErkhov
Params225M
Context128K
Q4_K_M0.2 GB
GGUF
PE
PersianMind v1.0
Persianmind · ysn-rfd
Params6.82B
Context2K
Smallest7.2 GB
GGUF
RO
Rombos 2.5 T.E 8.1 i1
Rombos · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LL
Easy-Systems/easy-ko-Llama3-8b-Instruct-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KO
kyujinpy Kosy platypus2 13B v4
Kosy · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
AT
AtheneX V2 72B Instruct
Athenex · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
SE
Self Forcing T2V 1.3B npu
Self · matrixportalx
Params1.42B
Context—
Smallest0.8 GB
GGUF
TH
LN Thai 14B v0.1
Thai · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
CU
Custom KoLLM 13B v4 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
DA
DataVortexS 10.7B v1.0
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
CU
Custom KoLLM 13B v7 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
PL
Kyujinpy Ko PlatYi 6B O
Platyi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
SM
Mt5 Small
Small · Matheusrdsantos
Params300M
Context512
Q4_K_M0.2 GB
GGUF
KR
Krishnai
Krishnai · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
ON
OneKE Q4 K M
Oneke · ADChahaha
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
GA
GaLLM 14B v0.2
Gallm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
LL
HumanF MarkrAI pub llama 13b v2
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
LL
Llama 2 Koen 13b
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
PH
CLIENS_PHI4_14B_BF16
Phi · yinghy2018
Params14.7B
Context16K
Smallest15.6 GB
GGUF
CO
Ada 1
Comma · dianab1729
Params7B
Context16K
Q4_K_M4.3 GB
GGUF
CH
chroma debug
Chroma · Clybius
Params8.9B
Context—
Smallest9.3 GB
GGUF
LL
Llama-3-KoEn-8B-Instruct-preview
Llama · Recaru
Params8.03B
Context8K
Smallest6.6 GB
GGUF
KY
kyujinpy PlatYi 34B Q
Kyujinpy · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
MI
Claire Mistral 7B 0.1 Q4 K M
Mistral · EZPK
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing