GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
TE
TextBase 7B v0.1 Q4 K M
Textbase · cleatherbury
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
WikiQwen 35B A3B
Wikiqwen · ramgpt
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
pub llama 13B v5
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
QW
sakura-14b-qwen2.5-v1.0
Qwen · zye1235357
Params14.8B
Context128K
Smallest12.1 GB
LU
Lunar 10.7B
Lunar · jeiku
Params10.7B
Context4K
Smallest4.0 GB
FR
Frankenstein MoE En 10.7Bx4
Frankenstein · tensorblock
Params36.1B
Context4K
Smallest13.2 GB
AA
Aarushhh yuno 225M python
Aarushhh · RichardErkhov
Params225M
Context128K
Q4_K_M0.2 GB
PE
PersianMind v1.0
Persianmind · ysn-rfd
Params6.82B
Context2K
Smallest7.2 GB
RO
Rombos 2.5 T.E 8.1 i1
Rombos · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Easy-Systems/easy-ko-Llama3-8b-Instruct-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
KO
kyujinpy Kosy platypus2 13B v4
Kosy · tensorblock
Params13B
Context2K
Smallest4.9 GB
AT
AtheneX V2 72B Instruct
Athenex · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
SE
Self Forcing T2V 1.3B npu
Self · matrixportalx
Params1.42B
Context—
Smallest0.8 GB
TH
LN Thai 14B v0.1
Thai · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
CU
Custom KoLLM 13B v4 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
DA
DataVortexS 10.7B v1.0
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
CU
Custom KoLLM 13B v7 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
PL
Kyujinpy Ko PlatYi 6B O
Platyi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
SM
Mt5 Small
Small · Matheusrdsantos
Params300M
Context512
Q4_K_M0.2 GB
KR
Krishnai
Krishnai · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
ON
OneKE Q4 K M
Oneke · ADChahaha
Params13.3B
Context4K
Q4_K_M8.0 GB
GA
GaLLM 14B v0.2
Gallm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
HumanF MarkrAI pub llama 13b v2
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
LL
Llama 2 Koen 13b
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
PH
CLIENS_PHI4_14B_BF16
Phi · yinghy2018
Params14.7B
Context16K
Smallest15.6 GB
CO
Ada 1
Comma · dianab1729
Params7B
Context16K
Q4_K_M4.3 GB
CH
chroma debug
Chroma · Clybius
Params8.9B
Context—
Smallest9.3 GB
LL
Llama-3-KoEn-8B-Instruct-preview
Llama · Recaru
Params8.03B
Context8K
Smallest6.6 GB
KY
kyujinpy PlatYi 34B Q
Kyujinpy · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
MI
Claire Mistral 7B 0.1 Q4 K M
Mistral · EZPK
Params7.24B
Context32K
Q4_K_M4.4 GB