GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
AP
Apollo v1 7b
Apollo · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
saishf Multi Verse RP 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
SOLAR 10.7B Instruct v1.0 128k
Solar · mradermacher
Params10.7B
Context128K
Q4_K_M6.5 GB
CH
CHILLGuard 8B
Chillguard · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
SO
SOVL-Mega-Mash-L3-8B
Sovl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SN
SniffyOtter 7B Novel Writing NSFW
Sniffyotter · Aratako
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
NY
Nyxene v2 11B i1
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
LY
Lyra4 Gutenberg2 12B i1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
FI
fireblossom 32K 7B i1
Fireblossom · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BE
Beagle14 7B
Beagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
Extended-Mega-Mash-262K-8B-L3
Extended · mradermacher
Params8.03B
Context256K
Q4_K_M4.9 GB
MI
eldogbbhed NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
SOVL-Mega-Mash-V2-L3-8B
Sovl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
FO
MN 12B FoxFrame Yukina i1
Foxframe · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2
Thesalt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Phainesthesia 8x7B i1
Phainesthesia · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
AY
aya-23-8B
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
TE
Tessera 4B Preview
Tessera · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
AY
Aya Expanse 8b
Aya · lmstudio-community
Params8.03B
Context8K
Q4_K_M5.1 GB
KA
Kanana Nano 2.1b Instruct Ko Reasoning
Kanana · mradermacher
Params2.32B
Context8K
Q4_K_M1.5 GB
NO
Nox Solar 10.7b v4 Kolon ITD 5 v2.2
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
YI
Yi 34Bx2 MoE 60B
Yi · second-state
Params60.8B
Context195K
Q4_K_M36.7 GB
JE
JerseyDevil 14b i1
Jerseydevil · mradermacher
Params14.2B
Context8K
Q4_K_M8.6 GB
FL
AI FLow OpticsReview 9B
Flow · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ST
L3 8B Stheno v3.2
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Noromaid v0.1 mixtral 8x7b Instruct v3 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
IN
Ina v11.1 i1
Ina · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
FR
franken kunoichi IDUS 11B i1
Franken · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
XL
xLAM 8x7b R
Xlam · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB