GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AP
Apollo v1 7b
Apollo · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingReasoning
SA
saishf Multi Verse RP 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
SO
SOLAR 10.7B Instruct v1.0 128k
Solar · mradermacher
Params10.7B
Context128K
Q4_K_M6.5 GB
GGUF
CH
CHILLGuard 8B
Chillguard · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
SO
SOVL-Mega-Mash-L3-8B
Sovl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SN
SniffyOtter 7B Novel Writing NSFW
Sniffyotter · Aratako
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
NY
Nyxene v2 11B i1
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LY
Lyra4 Gutenberg2 12B i1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
FI
fireblossom 32K 7B i1
Fireblossom · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
Beagle14 7B
Beagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Extended-Mega-Mash-262K-8B-L3
Extended · mradermacher
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
MI
eldogbbhed NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
SO
SOVL-Mega-Mash-V2-L3-8B
Sovl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FO
MN 12B FoxFrame Yukina i1
Foxframe · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2
Thesalt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
PH
Phainesthesia 8x7B i1
Phainesthesia · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
AY
aya-23-8B
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
TE
Tessera 4B Preview
Tessera · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
AY
Aya Expanse 8b
Aya · lmstudio-community
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
KA
Kanana Nano 2.1b Instruct Ko Reasoning
Kanana · mradermacher
Params2.32B
Context8K
Q4_K_M1.5 GB
ReasoningTool use
NO
Nox Solar 10.7b v4 Kolon ITD 5 v2.2
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
YI
Yi 34Bx2 MoE 60B
Yi · second-state
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
JE
JerseyDevil 14b i1
Jerseydevil · mradermacher
Params14.2B
Context8K
Q4_K_M8.6 GB
GGUF
FL
AI FLow OpticsReview 9B
Flow · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
ST
L3 8B Stheno v3.2
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Noromaid v0.1 mixtral 8x7b Instruct v3 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
IN
Ina v11.1 i1
Ina · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
FR
franken kunoichi IDUS 11B i1
Franken · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
XL
xLAM 8x7b R
Xlam · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use

Keep browsing