GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
EX
ExTrans 7B
Extrans · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DR
DRT O1 14B
Drt · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
HY
Hypernova Experimental
Hypernova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
WI
WikiQwen 9B
Wikiqwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MO
moonshine-tiny
Moonshine · cstr
Params27M
Context—
Smallest0.0 GB
MY
mythxl 70b
Mythxl · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3 VL 8B Instruct Minecraft MT En Zh
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GE
Gemma 4 E2B Yemeni Arabic Assistant Merged
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
OU
OuteTTS 0.3 1B
Outetts · OuteAI
Params1.19B
Context4K
Q4_K_M0.7 GB
MI
Asclepius-Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
ZO
zoyllm 7b slimorca
Zoyllm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
moonshine-base
Moonshine · cstr
Params62M
Context—
Smallest0.0 GB
LL
Taigi Llama 2 Translator 13B
Llama · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.0 GB
PL
Platypus2 70B
Platypus · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
MA
MarChat V1 27B
Marchat · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
GR
Granite Speech 5.0 470M TurboCTC NC
Granite · handy-computer
Params473M
Context—
Q4_K_M0.3 GB
GE
Gemma 4 E4B It Minecraft MT En Zh v0.1
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
KO
KOR Orca Platypus 13B v3 i1
Kor · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GE
Nau 1.0
Gemma · nau-ai
Params4.96B
Context128K
Q4_K_M3.7 GB
KO
KoR Orca Platypus 13B i1
Kor · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama 3.1 8B BookAdventures
Llama · KoboldAI
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
RAG KO Mixtral 7Bx2 v2.0
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
SA
Sakura 7B LNovel v0.9
Sakura · SakuraLLM
Params7.72B
Context32K
Q4_K_M4.9 GB
GE
Gemma 4 E2B Yemeni Arabic Assistant Merged
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
EV
EventLens 8B
Eventlens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3 Next 80B A3B Thinking SFT Uncensored
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
LL
Llama OuteTTS 1.0 1B
Llama · BricksDisplay
Params74M
Context—
Q4_K_M0.0 GB
KO
KoT platypus2 7B i1
Kot · mradermacher
Params6.86B
Context2K
Q4_K_M4.2 GB
WI
WikiQwen 35B A3B
Wikiqwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
IN
UI Ins 7B
Ins · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB