GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
FR
Frostwind 10.7B v1
Frostwind · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
LA
Lambda 17b PcDPO
Lambda · mradermacher
Params16.8B
Context32K
Q4_K_M10.3 GB
TH
TherapyBeagle 11B v1 i1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
SY
maywell_synatra-7b-v0.3-base
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
EU
Euryale L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
RW
rwitz_go-bruins
Rwitz · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SN
SniffyOtter 7B
Sniffyotter · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
NE
Nethena-20B
Nethena · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
ST
StartLux-Decision-v1.1-0.8B-Instant
Startlux · startlux-models
Params752M
Context256K
Q4_K_M0.5 GB
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
DA
DaringMaid 20B V1.1 i1
Daringmaid · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
AT
Athena v4
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GO
GodziLLa 30B i1
Godzilla · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
AL
AlphaMonarch 7B i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AS
Aspire 8B model stock i1
Aspire · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Patronus Lynx 8B Instruct
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
HO
HornyEchidna 13B v0.1
Hornyechidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
WI
Winterreise-m7
Winterreise · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
Chronos 70B v2
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
SP
SpatialAxiom 9B
Spatialaxiom · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
NA
NaruMOE-3x7B-v2
Narumoe · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
AT
Athena v2
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SE
Sensualize Solar 10.7B
Sensualize · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
YU
YuE2 3B Ruach Studio IRA Merge
Yue · goldhub
Params3.58B
Context—
Smallest2.9 GB
AY
aya-23-8B
Aya · legraphista
Params8B
Context8K
Smallest2.2 GB
WI
winter garden 7b delta
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GE
Octopus-v2
Gemma · NexaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
NO
Noromaid 20b v0.1.1 i1
Noromaid · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
RI
Rivermind 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
TH
TheSpice 7b FT ExperimentalOrca
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB