GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
CscSQL Merge Qwen2.5 Coder 0.5B Instruct
Qwen · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
CodingTool use
NE
NeuralBeagleJaskier i1
Neuralbeaglejaskier · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AC
AceInstruct 7B
Aceinstruct · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Coding
DA
DataVortexS 10.7B Dpo v1.3
Datavortexs · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
FL
undi95_flatdolphinmaid-8x7b
Flatdolphinmaid · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
CH
ChatWaifu_12B_v2.0
Chatwaifu · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MO
Monika 9B
Monika · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplayTool use
NO
X NoroChronos 13B
Norochronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
EC
Echidna-13b-v0.2
Echidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RO
RoLlama2 7b Instruct DPO 2024 10 09
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ZE
royallab_zephrp-m7b
Zephrp · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airoboros 7b Gpt4
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MO
mOrpheus_3B 1Base_early_preview v1 8600
Morpheus · KoljaB
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
MI
MN 12B Mimicore WhiteSnake i1
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NO
Nox Solar 10.7b v4 Kolon ITD 5 v2.1
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
VY
VyvoTTS LFM2 350M Jenny
Vyvotts · mradermacher
Params383M
Context125K
Q4_K_M0.3 GB
Tool use
IC
Ice0.16 02.10 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
NE
Neeto 1.0 8b
Neeto · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AY
Aya Expanse 32b Heretic
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
KA
Kanana Nano 2.1b Instruct
Kanana · mradermacher
Params2.09B
Context8K
Q4_K_M1.4 GB
GGUF
VE
Amber Fable 2.0
Vex · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
CodingReasoningTool use
MA
Maestrale Chat v0.3 Beta
Maestrale · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
Kunoichi 7B i1
Kunoichi · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
qwen 2.5 7b mai friend IQ4 NL
Qwen · zadaniamm
Params7.62B
Context32K
Smallest4.4 GB
GGUF
LL
Llama 3 Lumimaid 8b v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
XL
xLAM 7b Fc R
Xlam · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
Tool use
CO
c4ai-command-r-plus
Command R · LiteLLMs
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
IC
Ice0.147 17.10 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
RO
RoLlama2 7b Instruct DPO 2025 04 23
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AC
nvidia.AceMath 1.5B Instruct
Acemath · DevQuasar-7
Params1.78B
Context4K
Q4_K_M1.1 GB
GGUF

Keep browsing