GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
AT
athirdpath NSFW DPO Noromaid 7b
Athirdpath · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
Aya Expanse 32b Heretic
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
MI
Mimicore GreenSnake 22B i1
Mimicore · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
HW
hwkwon S SOLAR 10.7B SFT v1.2
Hwkwon · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
SO
Jsoo/solar-ko-common-merged
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
TI
CohereLabs.tiny Aya Base
Tiny · DevQuasar
Params3.35B
Context488K
Q4_K_M2.1 GB
MI
K2S3 Mistral 7bx2 48layers_v1.2
Mistral · mradermacher
Params10.9B
Context32K
Q4_K_M6.6 GB
KA
Kanana Nano 2.1b Base
Kanana · mradermacher
Params2.09B
Context8K
Q4_K_M1.4 GB
KU
Kuro Lotus 10.7B
Kuro · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
AY
Aya Expanse 8b Abliterated
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
KA
Kallamni 1.2b v1
Kallamni · mradermacher
Params1.17B
Context32K
Q4_K_M0.7 GB
LY
MN 12B Lyra v2a1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RO
rogue enchantress 32k 7B
Rogue · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
G COOM 9B V0.01
Coom · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
RE
WEBscrapePL 1.5b
Readerlm · cenkierpiotr
Params1.54B
Context501K
Q4_K_M1.0 GB
XL
xLAM 7b fc r
Xlam · Salesforce
Params6.91B
Context4K
Q4_K_M4.2 GB
VI
Vigyan Models
Vigyan · shreyansh12183
Params1.89B
Context4K
Q4_K_M1.2 GB
NI
L3.1 8B Niitama v1.1
Niitama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
DN
dnotitia.DNA R1
Dna · DevQuasar-9
Params14.7B
Context16K
Q4_K_M9.1 GB
MI
Synatra 7B Instruct v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
K2S3 SOLAR 11b v4.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
MA
distilabeled Marcoro14 7B slerp
Marcoro · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
maldv/winter-garden-7b-beta
Winter · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
XL
xLAM 8x7b R
Xlam · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
TH
L3-TheSpice-8b-v0.8.3
Thespice · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · mradermacher
Params8.04B
Context4192K
Q4_K_M4.9 GB
LL
Llama 3.05 NT Storybreaker Ministral 70B
Llama · Quant-Cartel
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 8B Instruct ortho baukit toxic v2 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
AY
aya-23-35B
Aya · mmnga
Params35B
Context8K
Q4_K_M21.5 GB
TO
Top Western Maid 7B i1
Top · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB