GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
TI
Tiny Knight 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
IC
IceLatteRP 7b
Icelatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Minerva v0.1
Minerva · AxoneSystem
Params30M
Context512
Smallest0.1 GB
CO
ColdBrew Nemo 12B Arcane Fusion Combined
Coldbrew · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
KU
kukulemon spiked 9B
Kukulemon · mradermacher
Params8.99B
Context8K
Q4_K_M5.4 GB
MI
decem/Dionysus-Mistral-m3-v6
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
paulml NeuralOmniWestBeaglake 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
DP
Yi Ko 6B dpo v5 i1
Dpo · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
AN
Anime Llasa 3B
Anime · mradermacher
Params3.41B
Context128K
Q4_K_M2.2 GB
IT
ITT Yi Ko 6B v1.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
NE
mlabonne/NeuralMarcoro14-7B
Neuralmarcoro · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Open_Maid_Samantha_Hermes_Orca
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
GLM5.3 Flash Variant Tev 320b Bf16
GLM · Merlinoz11
Params321B
Context1024K
Smallest156.8 GB
BU
Buttocks 7B v1.1 i1
Buttocks · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
Changgil/K2S3-SOLAR-11b-v3.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
DBCMLAB/Llama-3-instruction-constructionsafety-layertuning
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
PA
paulml NeuralOmniBeagleMBX v3 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Nova-13B
Nova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
NO
Noromaid 10.7B 0.4 DPO
Noromaid · mradermacher
Params10.7B
Context32K
Q4_K_M6.6 GB
SO
SOLAR 10.7B v1.6
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
QW
Qwen3.5 4B Nahida RP V2.1
Qwen · Moranyunchen
Params4.21B
Context256K
Q4_K_M2.7 GB
SO
SOLAR 10.7B Merge Dpo_V1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
CH
Chronos007 70b
Chronos · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama3 Unholy 8B OAS
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
BU
Buddy 2B v1
Buddy · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
GO
good robot
Good · joelewing
Params7.24B
Context32K
Q4_K_M4.4 GB
MB
MBTrix 7B
Mbtrix · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
LilithCore v1 12B
Lilithcore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
KI
ReMM v2 Kimiko v2 13B i1
Kimi · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AY
Aya Enes I2 8
Aya · mradermacher
Params6.28B
Context8K
Q4_K_M4.0 GB