GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
EC
Echidna 13b v0.3
Echidna · NeverSleep
Params13B
Context4K
Q4_K_M7.9 GB
KU
KuTrix 7b
Kutrix · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
Monika 31B
Monika · Green-eyedDevil
Params30.7B
Context256K
Q4_K_M18.7 GB
LL
Llama-3-Lumimaid-8B-v0.1
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
FA
FARE 8B
Fare · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
NE
Nemo 12b TheSpice V0.9 Base v2 i1
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ON
oneonlee KoSOLAR v0.2 gugutypus 10.7B
Oneonlee · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
MI
Dionysus Mistral M3 v6
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ON
ONeil-model_stock-7B
Oneil · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
JP
jpt 4b
Jpt · DreamBlooms
Params4.21B
Context256K
Smallest4.5 GB
GE
openhermes gemma 2b it
Gemma · MoMonir
Params2.51B
Context8K
Smallest2.1 GB
OP
Open Neural Monarch Maidv0.1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
algograpV4
Algograpv · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
LDCC Instruct Llama 2 Ko 13B v1.6
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
CO
Weyaxi/CollectiveCognition-v1.1-Nebula-7B
Collectivecognition · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PI
PiVoT MoE
Pivot · maywell
Params36.1B
Context32K
Q4_K_M20.4 GB
MI
Typhon Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
ME
Megatron Gpt2 345m
Megatron · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v3
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceMartiniV1RP 7b i1
Icemartiniv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KA
Kanana Nano 2.1b Instruct Abliterated
Kanana · mradermacher
Params2.09B
Context8K
Q4_K_M1.4 GB
SH
shark tank ai 7b v2 i1
Shark · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HW
hwkwon S SOLAR 10.7B v1.3
Hwkwon · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
AY
Aya Empati v2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
CO
C4Ai Command R Plus
Command R · mradermacher
Params104B
Context128K
Smallest39.5 GB
IC
IceAbsintheRP 7b imat GGUFs
Iceabsintherp · Casual-Autopsy
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
Salesforce.E1 Math 1.5B
Math · DevQuasar
Params1.78B
Context128K
Q4_K_M1.1 GB
CO
C4Ai Command A 03 2025
Command R · mmnga
Params111B
Context128K
Smallest24.6 GB
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · lmstudio-community
Params8.04B
Context4192K
Q4_K_M4.9 GB
YU
YuE2 Turbo Radio
Yue · Frosty40
Params3.63B
Context—
Smallest0.3 GB