GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
EC
Echidna 13b v0.3
Echidna · NeverSleep
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KU
KuTrix 7b
Kutrix · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
Monika 31B
Monika · Green-eyedDevil
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
LL
Llama-3-Lumimaid-8B-v0.1
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FA
FARE 8B
Fare · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Tool use
NE
Nemo 12b TheSpice V0.9 Base v2 i1
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ON
oneonlee KoSOLAR v0.2 gugutypus 10.7B
Oneonlee · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
MI
Dionysus Mistral M3 v6
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ON
ONeil-model_stock-7B
Oneil · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
JP
jpt 4b
Jpt · DreamBlooms
Params4.21B
Context256K
Smallest4.5 GB
GGUF
GE
openhermes gemma 2b it
Gemma · MoMonir
Params2.51B
Context8K
Smallest2.1 GB
Tool use
OP
Open Neural Monarch Maidv0.1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
algograpV4
Algograpv · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
LDCC Instruct Llama 2 Ko 13B v1.6
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
CO
Weyaxi/CollectiveCognition-v1.1-Nebula-7B
Collectivecognition · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PI
PiVoT MoE
Pivot · maywell
Params36.1B
Context32K
Q4_K_M20.4 GB
GGUF
MI
Typhon Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
ME
Megatron Gpt2 345m
Megatron · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v3
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceMartiniV1RP 7b i1
Icemartiniv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KA
Kanana Nano 2.1b Instruct Abliterated
Kanana · mradermacher
Params2.09B
Context8K
Q4_K_M1.4 GB
GGUF
SH
shark tank ai 7b v2 i1
Shark · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HW
hwkwon S SOLAR 10.7B v1.3
Hwkwon · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
AY
Aya Empati v2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
CO
C4Ai Command R Plus
Command R · mradermacher
Params104B
Context128K
Smallest39.5 GB
GGUF
IC
IceAbsintheRP 7b imat GGUFs
Iceabsintherp · Casual-Autopsy
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
Salesforce.E1 Math 1.5B
Math · DevQuasar
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
CO
C4Ai Command A 03 2025
Command R · mmnga
Params111B
Context128K
Smallest24.6 GB
Tool use
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · lmstudio-community
Params8.04B
Context4192K
Q4_K_M4.9 GB
Tool use
YU
YuE2 Turbo Radio
Yue · Frosty40
Params3.63B
Context—
Smallest0.3 GB
GGUF

Keep browsing