GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QU
quantumaikr_quantum-dpo-v0.1
Quantum · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
ProcObject Qwen3 VL 4B
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
SY
Synatra 7B v0.3 RP
Synatra · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Roleplay
JJ
JJ 1 2B
mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
HA
L3.1 70B Hanami X1
Hanami · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
XL
xLAM 1b Fc R
Xlam · gaianet
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use
SH
Sharp Fin v2 4b
Sharp · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
AM
U Amethyst 20B
Amethyst · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
HO
HOTHUN Stheno 3.2 v1.4
Hothun · Mykee
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
XL
xLAM 7b Fc R
Xlam · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Tool use
TO
Tower 7b EAX i1
Tower · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
EM
Emerhyst 20B
Emerhyst · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
AI
Airoboros Gpt 3.5 Turbo 100k 7b
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
Lyra Gutenberg mistral nemo 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Noromaid-v0.1-mixtral-8x7b
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
VE
MN 12B Vespa x1
Vespa · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3 Nephilim v2.1 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PS
PsyMedRP v1 20B
Psymedrp · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
HA
Harmonia 20B i1
Harmonia · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
QU
quds-v4-fa-f16
Quds · cstr
Params114M
Context—
Smallest0.1 GB
GGUF
CH
L3-8B-Chara-v1-Alpha
Chara · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 4B Uncensored
Qwen · Moranyunchen
Params4.21B
Context256K
Smallest2.3 GB
Vision
WI
WinterGoddess 1.4x 70B L2
Wintergoddess · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
IC
IceDrinkNameNotFoundRP 7b Model_Stock
Icedrinknamenotfoundrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-xLAM-2-8b-fc-r
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
Tool use
KU
kunoichi squared model stock 7B i1
Kunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Neural-SOVLish-Devil-8B-L3
Neural · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OC
octo-planner-2b
Octo · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
CO
c4ai-command-r-plus
Command R · qwp4w3hyb
Params104B
Context128K
Q4_K_M62.8 GB
GGUF

Keep browsing