GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
StopCarbon Ko 10.7B v2
Stopcarbon · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
CY
cyberpunk valerie v0.1
Cyberpunk · teleprint-me
Params90M
Context32K
Smallest0.0 GB
GGUF
AI
AILO-152M-v3
Ailo · xxrickyxx
Params152M
Context512
Q4_K_M0.1 GB
Reasoning
DO
DopeorNope SOLARC M 10.7B
Dopeornope · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
beomi/Llama-3-KoEn-8B-Instruct-preview
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
Merge Sakura Solar
Merge · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Gukbap Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3 Soliloquy 8B v1.5 64k i
Llama · SolidSnacke
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
ST
StopCarbon ko 10.7B v3
Stopcarbon · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
MP
mpt-7b-chat
Mpt · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
LL
elyn-dev/Llama-3-Soliloquy-8B-v2
Llama · featherless-ai-quants
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
MI
Mistral nemo ja rp v0.1
Mistral · ascktgcc
Params12.2B
Context1000K
Smallest7.1 GB
RoleplayTool use
ME
mExTrans 7B
Mextrans · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
SuperWriter Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
PlatYi 34B Llama Q v2
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
SO
M SOLAR 10.7B v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
PE
PersianMind v1.0
Persianmind · ysn-rfd
Params6.82B
Context2K
Smallest4.7 GB
GGUF
XU
Xuhuo 7b v3d7
XuhuoRenxian
Params7.5B
Context256K
Smallest6.2 GB
GGUF
LF
LFM2.5 2.6B JP 0811
Lfm · CloudGoat
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
BA
T5 Base
Base · Felladrin
Params248M
Context512
Smallest0.2 GB
GGUF
SC
SciPhi Triplex 4.0bpw h6 exl2
Sciphi · ibrahimkettaneh
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
AT
AtheneX V2 72B Instruct
Athenex · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
KO
LN Korean 7B v0.3
Korean · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
OR
Orca Mini 3B
Orca · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF
LL
PlatYi 34B Llama Q
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
TE
TextBase-7B-v0.1
Textbase · mgonzs13
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SP
splade v3 distilbert
Splade · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
Coding
LL
Llama2 13b Dpo v3
Llama · tensorblock
Params13.2B
Context4K
Smallest4.9 GB
GGUF
ZO
zoyllm_7b_slimorca
Zoyllm · tlphams
Params7.24B
Context32K
Smallest4.1 GB
GGUF
MP
Mosaicml Mpt 7b Chat
Mpt · tensorblock
Params6.65B
Context2K
Smallest2.6 GB
GGUF

Keep browsing