GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
ST
StopCarbon Ko 10.7B v2
Stopcarbon · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
CY
cyberpunk valerie v0.1
Cyberpunk · teleprint-me
Params90M
Context32K
Smallest0.0 GB
AI
AILO-152M-v3
Ailo · xxrickyxx
Params152M
Context512
Q4_K_M0.1 GB
DO
DopeorNope SOLARC M 10.7B
Dopeornope · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
beomi/Llama-3-KoEn-8B-Instruct-preview
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ME
Merge Sakura Solar
Merge · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Gukbap Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 Soliloquy 8B v1.5 64k i
Llama · SolidSnacke
Params8.03B
Context64K
Q4_K_M4.9 GB
ST
StopCarbon ko 10.7B v3
Stopcarbon · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
MP
mpt-7b-chat
Mpt · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
LL
elyn-dev/Llama-3-Soliloquy-8B-v2
Llama · featherless-ai-quants
Params8.03B
Context24K
Q4_K_M4.9 GB
MI
Mistral nemo ja rp v0.1
Mistral · ascktgcc
Params12.2B
Context1000K
Smallest7.1 GB
ME
mExTrans 7B
Mextrans · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
SuperWriter Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
PlatYi 34B Llama Q v2
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
SO
M SOLAR 10.7B v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
PE
PersianMind v1.0
Persianmind · ysn-rfd
Params6.82B
Context2K
Smallest4.7 GB
XU
Xuhuo 7b v3d7
XuhuoRenxian
Params7.5B
Context256K
Smallest6.2 GB
LF
LFM2.5 2.6B JP 0811
Lfm · CloudGoat
Params2.7B
Context128K
Q4_K_M1.7 GB
BA
T5 Base
Base · Felladrin
Params248M
Context512
Smallest0.2 GB
SC
SciPhi Triplex 4.0bpw h6 exl2
Sciphi · ibrahimkettaneh
Params3.82B
Context128K
Q4_K_M2.4 GB
AT
AtheneX V2 72B Instruct
Athenex · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
KO
LN Korean 7B v0.3
Korean · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
OR
Orca Mini 3B
Orca · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
LL
PlatYi 34B Llama Q
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
TE
TextBase-7B-v0.1
Textbase · mgonzs13
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
splade v3 distilbert
Splade · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
LL
Llama2 13b Dpo v3
Llama · tensorblock
Params13.2B
Context4K
Smallest4.9 GB
ZO
zoyllm_7b_slimorca
Zoyllm · tlphams
Params7.24B
Context32K
Smallest4.1 GB
MP
Mosaicml Mpt 7b Chat
Mpt · tensorblock
Params6.65B
Context2K
Smallest2.6 GB