GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
CU
Custom KoLLM 13B v3
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
CU
Custom KoLLM 13B v1
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
IN
InternVLA M1
Internvla · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool useVision
LL
Llama OuteTTS 1.0 1B
Llama · aoiandroid
Params1.25B
Context128K
Q4_K_M0.8 GB
GGUF
TO
Tower Plus 72B
Tower · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
SO
PracticeLLM/SOLAR-tail-10.7B-Merge-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SP
Spaetzle v68 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
LlamaLens
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GA
GaLLM 14B v0.1
Gallm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
DO
Dohnuts 0.1.0 0.8B
Dohnuts · DreamBlooms
Params752M
Context256K
Q4_K_M0.5 GB
CodingReasoningTool use
SO
SOLAR Platypus 10.7B v1
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
WI
Wizard Zephyr Orpo 8x22B i1
Wizard · mradermacher
Params141B
Context64K
Smallest29.6 GB
GGUF
TR
Triplex
Triplex · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
Llama 3.3 SuperSwallowX 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
GE
AriannaV2
Gemma · SurgeFF
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
DA
Edentns/DataVortexS-10.7B-dpo-v1.5
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.12
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SW
Swallow 70b RP EX
Swallow · mradermacher
Params69.3B
Context4K
Q4_K_M41.6 GB
Roleplay
QW
ace 0.5b
Qwen · ansh0x
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen3.5 0.8B JP Tuned v1.0
Qwen · CloudGoat
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
TE
T.E 8.1
mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
PL
PlatYi 34B Q i1
Platyi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
KO
KOS V4 Instruct
Kos · Kentucky-Open-Science
Params3.02B
Context64K
Q4_K_M1.8 GB
Tool use
11
111m i1
mradermacher
Params111M
Context2K
Q4_K_M0.1 GB
GGUF
ME
MemoChat Vicuna 7B
Memochat · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SA
Sakura SOLRCA Math Instruct DPO v2
Sakura · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
OU
Oute Tts
Oute · mradermacher
Params1.25B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3 Soliloquy 8B v2
Llama · RichardErkhov
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
GE
gemma 4 E4B it latex copyedit
Gemma · michelinolinolino
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
LL
Llama 3.1 Spellbound StoryWriter 70b instruct 0.4 16bit
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use

Keep browsing