GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GH
ghana voice anyin
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
MA
Mantis 50M Base
Mantis · kash8080
Params49M
Context1K
Smallest0.1 GB
GGUF
QW
naxi qwen3.5 4b
Qwen · Apeters247
Params4.84B
Context256K
Smallest3.5 GB
ReasoningTool use
LL
badger lambda 0 llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LI
Libra 19B
Libra · mradermacher
Params19.4B
Context4K
Q4_K_M11.9 GB
GGUF
MI
MistRP Dolphin 7B
Mistrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
IC
IceCaffeLatteRP-7b
Icecaffelatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NY
Nyxene v2 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
CO
coedit large Q4 K M
Coedit · OlyMahmud
Params783M
Context512
Q4_K_M0.5 GB
GGUF
DE
vidhi ai 1.5b sovereign masterpiece
DeepSeek · shreyansh12183
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
EM
Emerhyst 20B GGUF fork
Emerhyst · chaitnya26
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
MI
Disinfo4 mistral ft optimized 1218
Mistral · disinfozone
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UT
UtopiaXL 13B
Utopiaxl · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
ChatWaifu_v1.2.1
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
AL
AlphaMist7B Slr v1
Alphamist · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8B Instruct ortho baukit toxic v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SM
Smegmma Deluxe 9B v1
Smegmma · BeaverLegacy
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama-3-Lumimaid-8B-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ZE
Zembed 1
Zembed · Abiray
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingReasoningTool use
HA
Hala 1.2B
Hala · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
MI
Mixtral_7Bx2_MoE
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
KU
kukulemon 32K 7B
Kukulemon · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airoboros 7b
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
VI
VieNeu TTS Twi
Vieneu · michsethowusu
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
CohereForAI Aya Expanse 32b
Aya · tensorblock
Params32.3B
Context8K
Smallest12.8 GB
GGUF
IC
IceDrunkenCherryRP 7b
Icedrunkencherryrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SI
Silicon Masha 7B
Silicon · LakoMoor
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CO
Command A 03 2025 Uncut
Command · mradermacher
Params111B
Context128K
Smallest42.1 GB
Tool use
TH
Thespis CurtainCall 7b v0.1.2
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing