GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
SO
SOVL-Mega-Mash-L3-8B
Sovl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
NO
Noromaid 13b v0.3
Noromaid · NeverSleep
Params13B
Context4K
Smallest7.4 GB
AI
Airoboros 33b 3.1.2
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
Llama-3-Lumimaid-70B-v0.1-OAS
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
NO
NeverSleep/Noromaid-13b-v0.3
Noromaid · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
NE
Nethena 13B
Nethena · NeverSleep
Params13B
Context4K
Q4_K_M7.9 GB
DA
DAVinCI Yi Ko 6B v1.1
Davinci · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
TH
L3.1 8b TheSpice V0.9 Base v2
Thespice · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Naxi Qwen3 14b v5 Merged
Qwen · Apeters247
Params14.8B
Context40K
Q4_K_M9.0 GB
LU
fblgit/LUNA-SOLARkrautLM-Instruct
Luna · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
NE
Neural SOVLish Devil 8B L3
Neural · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
K2
K2S3 v0.1
mradermacher
Params14.4B
Context32K
Q4_K_M8.6 GB
GE
gemma 2b openhermes i1
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
AI
Airoboros 13b Gpt4
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LU
Lumimaid v0.2 12B Heretic
Lumimaid · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
NeverSleep Llama 3 Lumimaid 70B v0.1 alt
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
MY
Muhammad2003/Myriad-7B-Slerp
Myriad · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
Spaetzle v60 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HC
Hcx 0.5b Nothink
Hcx · mradermacher
Params566M
Context8K
Q4_K_M0.4 GB
SO
SOLAR 10.7B Merge Dpo
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
Frostwind Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
XL
xLAM 2 3b Fc R
Xlam · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
NA
Nautilus RP 18B v2
Nautilus · mradermacher
Params18.2B
Context1000K
Q4_K_M11.1 GB
CA
Cat 8x7B
Cat · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
SO
S SOLAR 10.7B SFT v1.3 i1
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
TheDrummer Llama 3SOME 8B v2
Llama · RichardErkhov
Params8.03B
Context10K
Q4_K_M4.9 GB
LL
badger nu llama 3.1 8B UltraLong i1
Llama · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
BA
MN BackyardAI Party 12B v1
Backyardai · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
MO
Moist Miqu 70B v1 i1
Moist · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
XL
xLAM 8x22b R
Xlam · gaianet
Params141B
Context64K
Q4_K_M85.6 GB