GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
PlatYi 34B Llama Q v3
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
SE
Wan2.1 T2V 1.3B SelfForcing VACE
Self · lym00
Params2.15B
Context—
Q4_K_M1.5 GB
GGUF
CA
CarbonVillain En 10.7B v4
Carbonvillain · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ST
carperai_stable-vicuna-13b-delta
Stable · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Llama-3-Soliloquy-8B-v2
Llama · mradermacher
Params8B
Context24K
Q4_K_M4.9 GB
GGUF
UN
fblgit_unaversal-8x7b-v1beta
Unaversal · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
BI
BiMediX2 8B Hf
Bimedix · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Sakura SOLRCA Math Instruct DPO v2
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CA
CarbonVillain En 10.7B v4
Carbonvillain · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
YU
YuE2 RS 4.0x0.7
Yue · scragnog
Params3.63B
Context24K
Q4_K_M2.4 GB
GGUF
LL
pub llama 13B v5 i1
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
Asclepius-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
TextBase 7B v0.1
Textbase · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
AriannaV4_merged
Gemma · SurgeFF
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
CU
Custom KoLLM 13B v3 i1
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
TO
Tower Plus 9B
Tower · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TL
tlphams solar 10.7b merged v0.1
Tlphams · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TO
Tower Plus 72B
Tower · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Slava Qwen3 14B Serbian
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
MP
Mpt 30b Chat
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
Coding
TE
TextBase OSS 20B 0203
Textbase · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
ST
Stablelm Tuned Alpha 3b
Stablelm · mradermacher
Params3.64B
Context4K
Q4_K_M2.3 GB
GGUF
DA
DataVortexTL 1.1B v0.1
Datavortextl · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
BA
BatchOnline GRPO 7B
Batchonline · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
BE
beomi Yi Ko 34B Chat Preview
Beomi · RichardErkhov
Params34.6B
Context2K
Q4_K_M20.8 GB
GGUF
OU
OuteTTS 0.3 1B
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
GGUF
LL
Llama-3-Soliloquy-8B-v2
Llama · mradermacher
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 E4B It Minecraft MT En Zh v0.1
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
TO
Tower Plus 72B Ultra Uncensored Heretic
Tower · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
MI
Mistral nemo ja rp v0.2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use

Keep browsing