GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
COLA3 7B
Cola · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
KO
KOR Orca Platypus 13B v3
Kor · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OR
orca mini 3b i1
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
ME
TroyDoesAI/MermaidSolar
Mermaidsolar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ME
.\TroyDoesAI_MermaidSolar\
Mermaidsolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
qwen2beta
Qwen · SakuraLLM
Params1.84B
Context32K
Smallest3.7 GB
GGUF
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
QW
Sakura 14B Qwen2beta v0.9
Qwen · SakuraLLM
Params14.2B
Context32K
Smallest7.8 GB
GGUF
AI
AIFT PACK 13b v1.1
Aift · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.8
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
Easy Ko Llama3 8b Instruct v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QW
ROLEPL AI v2 Qwen2.5 7B
Qwen · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
RoleplayTool use
PL
Kyujinpy PlatYi 34B LoRA
Platyi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
CR
Cran-May/T.E-8.1
featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
AI
Ailo152m v2 ita
Ailo · xxrickyxx
Params152M
Context512
Q4_K_M0.1 GB
CodingReasoning
LL
pub llama 13B v6
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
OO
OOM 13B 01
Oom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
SP
SpiroLLM
Spirollm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DR
DRT O1 14B
Drt · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
Tool use
LL
Llama 3 KoEn 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CA
Cartinoe5930 weak KoRAE 13b
Cartinoe · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
MK
MKLLM 7B Instruct
Mkllm · martinkozle
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
ToolRM Gen Qwen3 4B Thinking 2507
Qwen · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
EL
Elysium X 500 FR
Elysium · open-nhe
Params1.54B
Context32K
Smallest1.6 GB
Tool use
KO
LN Korean 14B v0.1
Korean · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
MI
MicroTask mini guanaco 200k
Microtask · mradermacher
Params86M
Context2K
Q4_K_M0.1 GB
GGUF
DA
DataVortexS 10.7B v1.0
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
OR
orca mini 3b
Orca · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
GGUF
PL
PlatYi 34B LoRA
Platyi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
MI
RAG KO Mixtral 7Bx2 v2.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF

Keep browsing