GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
LL
PlatYi 34B Llama Q v3
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
SE
Wan2.1 T2V 1.3B SelfForcing VACE
Self · lym00
Params2.15B
Context—
Q4_K_M1.5 GB
CA
CarbonVillain En 10.7B v4
Carbonvillain · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
ST
carperai_stable-vicuna-13b-delta
Stable · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama-3-Soliloquy-8B-v2
Llama · mradermacher
Params8B
Context24K
Q4_K_M4.9 GB
UN
fblgit_unaversal-8x7b-v1beta
Unaversal · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
BI
BiMediX2 8B Hf
Bimedix · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
Sakura SOLRCA Math Instruct DPO v2
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
CA
CarbonVillain En 10.7B v4
Carbonvillain · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
YU
YuE2 RS 4.0x0.7
Yue · scragnog
Params3.63B
Context24K
Q4_K_M2.4 GB
LL
pub llama 13B v5 i1
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
LL
Asclepius-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
TE
TextBase 7B v0.1
Textbase · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
AriannaV4_merged
Gemma · SurgeFF
Params11.9B
Context256K
Q4_K_M7.4 GB
CU
Custom KoLLM 13B v3 i1
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
TO
Tower Plus 9B
Tower · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
TL
tlphams solar 10.7b merged v0.1
Tlphams · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
TO
Tower Plus 72B
Tower · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Slava Qwen3 14B Serbian
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
MP
Mpt 30b Chat
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
TE
TextBase OSS 20B 0203
Textbase · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
ST
Stablelm Tuned Alpha 3b
Stablelm · mradermacher
Params3.64B
Context4K
Q4_K_M2.3 GB
DA
DataVortexTL 1.1B v0.1
Datavortextl · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
BA
BatchOnline GRPO 7B
Batchonline · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
BE
beomi Yi Ko 34B Chat Preview
Beomi · RichardErkhov
Params34.6B
Context2K
Q4_K_M20.8 GB
OU
OuteTTS 0.3 1B
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
LL
Llama-3-Soliloquy-8B-v2
Llama · mradermacher
Params8.03B
Context24K
Q4_K_M4.9 GB
GE
Gemma 4 E4B It Minecraft MT En Zh v0.1
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
TO
Tower Plus 72B Ultra Uncensored Heretic
Tower · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
Mistral nemo ja rp v0.2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB