GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
FR
Frostwind 10.7B v1
Frostwind · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LA
Lambda 17b PcDPO
Lambda · mradermacher
Params16.8B
Context32K
Q4_K_M10.3 GB
Roleplay
TH
TherapyBeagle 11B v1 i1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
SY
maywell_synatra-7b-v0.3-base
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EU
Euryale L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
RW
rwitz_go-bruins
Rwitz · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SN
SniffyOtter 7B
Sniffyotter · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
NE
Nethena-20B
Nethena · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
ST
StartLux-Decision-v1.1-0.8B-Instant
Startlux · startlux-models
Params752M
Context256K
Q4_K_M0.5 GB
Vision
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
DA
DaringMaid 20B V1.1 i1
Daringmaid · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
AT
Athena v4
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GO
GodziLLa 30B i1
Godzilla · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
GGUF
AL
AlphaMonarch 7B i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AS
Aspire 8B model stock i1
Aspire · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Patronus Lynx 8B Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
HO
HornyEchidna 13B v0.1
Hornyechidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
Winterreise-m7
Winterreise · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Chronos 70B v2
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Roleplay
SP
SpatialAxiom 9B
Spatialaxiom · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
NA
NaruMOE-3x7B-v2
Narumoe · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
Roleplay
AT
Athena v2
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SE
Sensualize Solar 10.7B
Sensualize · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
YU
YuE2 3B Ruach Studio IRA Merge
Yue · goldhub
Params3.58B
Context—
Smallest2.9 GB
GGUF
AY
aya-23-8B
Aya · legraphista
Params8B
Context8K
Smallest2.2 GB
GGUF
WI
winter garden 7b delta
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
GE
Octopus-v2
Gemma · NexaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
NO
Noromaid 20b v0.1.1 i1
Noromaid · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
RI
Rivermind 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
TH
TheSpice 7b FT ExperimentalOrca
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF

Keep browsing