GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
EX
ExTrans 7B
Extrans · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
DR
DRT O1 14B
Drt · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
HY
Hypernova Experimental
Hypernova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
WikiQwen 9B
Wikiqwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
GGUF
MY
mythxl 70b
Mythxl · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3 VL 8B Instruct Minecraft MT En Zh
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
GE
Gemma 4 E2B Yemeni Arabic Assistant Merged
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
OU
OuteTTS 0.3 1B
Outetts · OuteAI
Params1.19B
Context4K
Q4_K_M0.7 GB
GGUF
MI
Asclepius-Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
ZO
zoyllm 7b slimorca
Zoyllm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
GGUF
LL
Taigi Llama 2 Translator 13B
Llama · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
PL
Platypus2 70B
Platypus · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MA
MarChat V1 27B
Marchat · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
GR
Granite Speech 5.0 470M TurboCTC NC
Granite · handy-computer
Params473M
Context—
Q4_K_M0.3 GB
GGUF
GE
Gemma 4 E4B It Minecraft MT En Zh v0.1
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
KO
KOR Orca Platypus 13B v3 i1
Kor · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
GE
Nau 1.0
Gemma · nau-ai
Params4.96B
Context128K
Q4_K_M3.7 GB
ReasoningTool useVision
KO
KoR Orca Platypus 13B i1
Kor · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.1 8B BookAdventures
Llama · KoboldAI
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
RAG KO Mixtral 7Bx2 v2.0
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
SA
Sakura 7B LNovel v0.9
Sakura · SakuraLLM
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 E2B Yemeni Arabic Assistant Merged
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
EV
EventLens 8B
Eventlens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Qwen3 Next 80B A3B Thinking SFT Uncensored
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
ReasoningTool use
LL
Llama OuteTTS 1.0 1B
Llama · BricksDisplay
Params74M
Context—
Q4_K_M0.0 GB
GGUF
KO
KoT platypus2 7B i1
Kot · mradermacher
Params6.86B
Context2K
Q4_K_M4.2 GB
GGUF
WI
WikiQwen 35B A3B
Wikiqwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
IN
UI Ins 7B
Ins · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF

Keep browsing