GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SO
SOVL-Mega-Mash-L3-8B
Sovl · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NO
Noromaid 13b v0.3
Noromaid · NeverSleep
Params13B
Context4K
Smallest7.4 GB
GGUF
AI
Airoboros 33b 3.1.2
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LL
Llama-3-Lumimaid-70B-v0.1-OAS
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NO
NeverSleep/Noromaid-13b-v0.3
Noromaid · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
Nethena 13B
Nethena · NeverSleep
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DA
DAVinCI Yi Ko 6B v1.1
Davinci · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
TH
L3.1 8b TheSpice V0.9 Base v2
Thespice · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Naxi Qwen3 14b v5 Merged
Qwen · Apeters247
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
LU
fblgit/LUNA-SOLARkrautLM-Instruct
Luna · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
NE
Neural SOVLish Devil 8B L3
Neural · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
K2
K2S3 v0.1
mradermacher
Params14.4B
Context32K
Q4_K_M8.6 GB
GGUF
GE
gemma 2b openhermes i1
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
Tool use
AI
Airoboros 13b Gpt4
Airoboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LU
Lumimaid v0.2 12B Heretic
Lumimaid · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
NeverSleep Llama 3 Lumimaid 70B v0.1 alt
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MY
Muhammad2003/Myriad-7B-Slerp
Myriad · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SP
Spaetzle v60 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HC
Hcx 0.5b Nothink
Hcx · mradermacher
Params566M
Context8K
Q4_K_M0.4 GB
Reasoning
SO
SOLAR 10.7B Merge Dpo
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
Frostwind Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
XL
xLAM 2 3b Fc R
Xlam · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
NA
Nautilus RP 18B v2
Nautilus · mradermacher
Params18.2B
Context1000K
Q4_K_M11.1 GB
RoleplayTool use
CA
Cat 8x7B
Cat · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
SO
S SOLAR 10.7B SFT v1.3 i1
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
TheDrummer Llama 3SOME 8B v2
Llama · RichardErkhov
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
LL
badger nu llama 3.1 8B UltraLong i1
Llama · mradermacher
Params8.03B
Context1048K
Q4_K_M4.9 GB
Tool use
BA
MN BackyardAI Party 12B v1
Backyardai · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MO
Moist Miqu 70B v1 i1
Moist · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
XL
xLAM 8x22b R
Xlam · gaianet
Params141B
Context64K
Q4_K_M85.6 GB
Tool use

Keep browsing