GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
GH
ghana voice anyin
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
MA
Mantis 50M Base
Mantis · kash8080
Params49M
Context1K
Smallest0.1 GB
QW
naxi qwen3.5 4b
Qwen · Apeters247
Params4.84B
Context256K
Smallest3.5 GB
LL
badger lambda 0 llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
Libra 19B
Libra · mradermacher
Params19.4B
Context4K
Q4_K_M11.9 GB
MI
MistRP Dolphin 7B
Mistrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
IC
IceCaffeLatteRP-7b
Icecaffelatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NY
Nyxene v2 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
CO
coedit large Q4 K M
Coedit · OlyMahmud
Params783M
Context512
Q4_K_M0.5 GB
DE
vidhi ai 1.5b sovereign masterpiece
DeepSeek · shreyansh12183
Params1.78B
Context128K
Q4_K_M1.1 GB
EM
Emerhyst 20B GGUF fork
Emerhyst · chaitnya26
Params20B
Context4K
Q4_K_M12.0 GB
MI
Disinfo4 mistral ft optimized 1218
Mistral · disinfozone
Params7.24B
Context32K
Q4_K_M4.4 GB
UT
UtopiaXL 13B
Utopiaxl · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
CH
ChatWaifu_v1.2.1
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
AL
AlphaMist7B Slr v1
Alphamist · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 8B Instruct ortho baukit toxic v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SM
Smegmma Deluxe 9B v1
Smegmma · BeaverLegacy
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama-3-Lumimaid-8B-v0.1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ZE
Zembed 1
Zembed · Abiray
Params4.02B
Context40K
Q4_K_M2.5 GB
HA
Hala 1.2B
Hala · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
MI
Mixtral_7Bx2_MoE
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
KU
kukulemon 32K 7B
Kukulemon · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airoboros 7b
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
VI
VieNeu TTS Twi
Vieneu · michsethowusu
Params244M
Context4K
Q4_K_M0.2 GB
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
CohereForAI Aya Expanse 32b
Aya · tensorblock
Params32.3B
Context8K
Smallest12.8 GB
IC
IceDrunkenCherryRP 7b
Icedrunkencherryrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SI
Silicon Masha 7B
Silicon · LakoMoor
Params7.24B
Context8K
Q4_K_M4.4 GB
CO
Command A 03 2025 Uncut
Command · mradermacher
Params111B
Context128K
Smallest42.1 GB
TH
Thespis CurtainCall 7b v0.1.2
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB