GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
WikiQwen 35B A3B
Wikiqwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
SE
sea lion 7b instruct research i1
Sea · mradermacher
Params7.5B
Context2K
Q4_K_M5.0 GB
GGUF
KO
KoR Orca Platypus 13B
Kor · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
PL
PlatYi 34B 200K Q
Platyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
PL
Kyujinpy Ko PlatYi 6B Kiwi
Platyi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LL
Puluming AISquare Instruct llama2 koen 13b v0.9.15
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.0
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SW
Swallow MoE 4x7B Lisa
Swallow · mradermacher
Params19.8B
Context4K
Q4_K_M12.0 GB
CodingRoleplay
SO
SOLAR Tail 10.7B Instruct v1.0
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
radcheck qwen35 4b gguf es
Qwen · Crstian19
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Qwen3 4B Thinking 2507 SFT Uncensored
Qwen · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
DP
DPO Think 14B
Dpo · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
SP
Spark TTS 0.5B
Spark · mradermacher
Params507M
Context32K
Q4_K_M0.4 GB
Tool use
KO
LN Korean 7B v0.3 i1
Korean · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
TE
TextBase OSS 20B 0203
Textbase · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
LL
Taigi Llama 2 Chat 7B
Llama · mradermacher
Params6.94B
Context4K
Q4_K_M4.2 GB
GGUF
LL
CoT llama 2k 7b
Llama · mradermacher
Params6.86B
Context2K
Q4_K_M4.2 GB
GGUF
MI
OpenLLM France.Claire Mistral 7B 0.1
Mistral · DevQuasar-9
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DR
DRT 8B
Drt · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DA
DataVortexS 10.7B Dpo v1.12
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SP
splade v2 distil
Splade · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
Coding
TO
TowerVision 2B
Towervision · nyuuzyou
Params2.61B
Context8K
Q4_K_M1.7 GB
Vision
SA
kyujinpy/Sakura-SOLAR-Instruct-DPO-v2
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 2 Koen 13b
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
SE
Self Forcing2.1 T2V 1.3B
Self · Nichonauta
Params1.42B
Context—
Smallest0.8 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.6
Datavortexs · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
QW
Qwen3.5 0.8B JP Tuned v2.0
Qwen · CloudGoat
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
ME
Merak 7B v5 PROTOTYPE1
Merak · Ichsan2895
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 2 Koen 13b slimOrca
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
TE
Tempmotacilla Cinerea 0302
Tempmotacilla · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use

Keep browsing