GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
CO
COLA3 7B
Cola · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
KO
KOR Orca Platypus 13B v3
Kor · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
OR
orca mini 3b i1
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
ME
TroyDoesAI/MermaidSolar
Mermaidsolar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
ME
.\TroyDoesAI_MermaidSolar\
Mermaidsolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
qwen2beta
Qwen · SakuraLLM
Params1.84B
Context32K
Smallest3.7 GB
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
QW
Sakura 14B Qwen2beta v0.9
Qwen · SakuraLLM
Params14.2B
Context32K
Smallest7.8 GB
AI
AIFT PACK 13b v1.1
Aift · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
DA
DataVortexS 10.7B Dpo v1.8
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
Easy Ko Llama3 8b Instruct v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QW
ROLEPL AI v2 Qwen2.5 7B
Qwen · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
PL
Kyujinpy PlatYi 34B LoRA
Platyi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
CR
Cran-May/T.E-8.1
featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
AI
Ailo152m v2 ita
Ailo · xxrickyxx
Params152M
Context512
Q4_K_M0.1 GB
LL
pub llama 13B v6
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
OO
OOM 13B 01
Oom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
SP
SpiroLLM
Spirollm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DR
DRT O1 14B
Drt · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
LL
Llama 3 KoEn 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CA
Cartinoe5930 weak KoRAE 13b
Cartinoe · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
MK
MKLLM 7B Instruct
Mkllm · martinkozle
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
ToolRM Gen Qwen3 4B Thinking 2507
Qwen · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
EL
Elysium X 500 FR
Elysium · open-nhe
Params1.54B
Context32K
Smallest1.6 GB
KO
LN Korean 14B v0.1
Korean · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
MI
MicroTask mini guanaco 200k
Microtask · mradermacher
Params86M
Context2K
Q4_K_M0.1 GB
DA
DataVortexS 10.7B v1.0
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
OR
orca mini 3b
Orca · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
PL
PlatYi 34B LoRA
Platyi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
MI
RAG KO Mixtral 7Bx2 v2.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB