GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AT
athirdpath NSFW DPO Noromaid 7b
Athirdpath · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya Expanse 32b Heretic
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
MI
Mimicore GreenSnake 22B i1
Mimicore · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
HW
hwkwon S SOLAR 10.7B SFT v1.2
Hwkwon · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
SO
Jsoo/solar-ko-common-merged
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TI
CohereLabs.tiny Aya Base
Tiny · DevQuasar
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
MI
K2S3 Mistral 7bx2 48layers_v1.2
Mistral · mradermacher
Params10.9B
Context32K
Q4_K_M6.6 GB
GGUF
KA
Kanana Nano 2.1b Base
Kanana · mradermacher
Params2.09B
Context8K
Q4_K_M1.4 GB
GGUF
KU
Kuro Lotus 10.7B
Kuro · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
KA
Kallamni 1.2b v1
Kallamni · mradermacher
Params1.17B
Context32K
Q4_K_M0.7 GB
GGUF
LY
MN 12B Lyra v2a1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
RO
rogue enchantress 32k 7B
Rogue · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
G COOM 9B V0.01
Coom · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
RE
WEBscrapePL 1.5b
Readerlm · cenkierpiotr
Params1.54B
Context501K
Q4_K_M1.0 GB
GGUF
XL
xLAM 7b fc r
Xlam · Salesforce
Params6.91B
Context4K
Q4_K_M4.2 GB
Tool use
VI
Vigyan Models
Vigyan · shreyansh12183
Params1.89B
Context4K
Q4_K_M1.2 GB
GGUF
NI
L3.1 8B Niitama v1.1
Niitama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DN
dnotitia.DNA R1
Dna · DevQuasar-9
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
MI
Synatra 7B Instruct v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
K2S3 SOLAR 11b v4.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MA
distilabeled Marcoro14 7B slerp
Marcoro · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
maldv/winter-garden-7b-beta
Winter · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 8x7b R
Xlam · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
TH
L3-TheSpice-8b-v0.8.3
Thespice · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · mradermacher
Params8.04B
Context4192K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.05 NT Storybreaker Ministral 70B
Llama · Quant-Cartel
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3 8B Instruct ortho baukit toxic v2 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AY
aya-23-35B
Aya · mmnga
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
TO
Top Western Maid 7B i1
Top · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing