GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
Tiny Knight 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
IC
IceLatteRP 7b
Icelatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Minerva v0.1
Minerva · AxoneSystem
Params30M
Context512
Smallest0.1 GB
GGUF
CO
ColdBrew Nemo 12B Arcane Fusion Combined
Coldbrew · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KU
kukulemon spiked 9B
Kukulemon · mradermacher
Params8.99B
Context8K
Q4_K_M5.4 GB
GGUF
MI
decem/Dionysus-Mistral-m3-v6
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
paulml NeuralOmniWestBeaglake 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DP
Yi Ko 6B dpo v5 i1
Dpo · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
AN
Anime Llasa 3B
Anime · mradermacher
Params3.41B
Context128K
Q4_K_M2.2 GB
Tool use
IT
ITT Yi Ko 6B v1.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
NE
mlabonne/NeuralMarcoro14-7B
Neuralmarcoro · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Open_Maid_Samantha_Hermes_Orca
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GL
GLM5.3 Flash Variant Tev 320b Bf16
GLM · Merlinoz11
Params321B
Context1024K
Smallest156.8 GB
ReasoningTool use
BU
Buttocks 7B v1.1 i1
Buttocks · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
Changgil/K2S3-SOLAR-11b-v3.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
DBCMLAB/Llama-3-instruction-constructionsafety-layertuning
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PA
paulml NeuralOmniBeagleMBX v3 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Nova-13B
Nova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NO
Noromaid 10.7B 0.4 DPO
Noromaid · mradermacher
Params10.7B
Context32K
Q4_K_M6.6 GB
GGUF
SO
SOLAR 10.7B v1.6
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
QW
Qwen3.5 4B Nahida RP V2.1
Qwen · Moranyunchen
Params4.21B
Context256K
Q4_K_M2.7 GB
RoleplayVision
SO
SOLAR 10.7B Merge Dpo_V1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CH
Chronos007 70b
Chronos · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama3 Unholy 8B OAS
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BU
Buddy 2B v1
Buddy · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GO
good robot
Good · joelewing
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MB
MBTrix 7B
Mbtrix · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LI
LilithCore v1 12B
Lilithcore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KI
ReMM v2 Kimiko v2 13B i1
Kimi · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AY
Aya Enes I2 8
Aya · mradermacher
Params6.28B
Context8K
Q4_K_M4.0 GB
GGUF

Keep browsing