GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
WI
WikiQwen 35B A3B
Wikiqwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
SE
sea lion 7b instruct research i1
Sea · mradermacher
Params7.5B
Context2K
Q4_K_M5.0 GB
KO
KoR Orca Platypus 13B
Kor · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
PL
PlatYi 34B 200K Q
Platyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
PL
Kyujinpy Ko PlatYi 6B Kiwi
Platyi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
LL
Puluming AISquare Instruct llama2 koen 13b v0.9.15
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
DA
DataVortexS 10.7B Dpo v1.0
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
SW
Swallow MoE 4x7B Lisa
Swallow · mradermacher
Params19.8B
Context4K
Q4_K_M12.0 GB
SO
SOLAR Tail 10.7B Instruct v1.0
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
radcheck qwen35 4b gguf es
Qwen · Crstian19
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3 4B Thinking 2507 SFT Uncensored
Qwen · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
DP
DPO Think 14B
Dpo · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
SP
Spark TTS 0.5B
Spark · mradermacher
Params507M
Context32K
Q4_K_M0.4 GB
KO
LN Korean 7B v0.3 i1
Korean · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
TE
TextBase OSS 20B 0203
Textbase · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LL
Taigi Llama 2 Chat 7B
Llama · mradermacher
Params6.94B
Context4K
Q4_K_M4.2 GB
LL
CoT llama 2k 7b
Llama · mradermacher
Params6.86B
Context2K
Q4_K_M4.2 GB
MI
OpenLLM France.Claire Mistral 7B 0.1
Mistral · DevQuasar-9
Params7.24B
Context32K
Q4_K_M4.4 GB
DR
DRT 8B
Drt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DA
DataVortexS 10.7B Dpo v1.12
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
SP
splade v2 distil
Splade · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
TO
TowerVision 2B
Towervision · nyuuzyou
Params2.61B
Context8K
Q4_K_M1.7 GB
SA
kyujinpy/Sakura-SOLAR-Instruct-DPO-v2
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama 2 Koen 13b
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
SE
Self Forcing2.1 T2V 1.3B
Self · Nichonauta
Params1.42B
Context—
Smallest0.8 GB
DA
DataVortexS 10.7B Dpo v1.6
Datavortexs · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
QW
Qwen3.5 0.8B JP Tuned v2.0
Qwen · CloudGoat
Params752M
Context256K
Smallest0.8 GB
ME
Merak 7B v5 PROTOTYPE1
Merak · Ichsan2895
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 2 Koen 13b slimOrca
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
TE
Tempmotacilla Cinerea 0302
Tempmotacilla · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB