GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
CU
Custom KoLLM 13B v3
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
CU
Custom KoLLM 13B v1
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
IN
InternVLA M1
Internvla · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
LL
Llama OuteTTS 1.0 1B
Llama · aoiandroid
Params1.25B
Context128K
Q4_K_M0.8 GB
TO
Tower Plus 72B
Tower · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
SO
PracticeLLM/SOLAR-tail-10.7B-Merge-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
SP
Spaetzle v68 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
LlamaLens
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GA
GaLLM 14B v0.1
Gallm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DO
Dohnuts 0.1.0 0.8B
Dohnuts · DreamBlooms
Params752M
Context256K
Q4_K_M0.5 GB
SO
SOLAR Platypus 10.7B v1
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
WI
Wizard Zephyr Orpo 8x22B i1
Wizard · mradermacher
Params141B
Context64K
Smallest29.6 GB
TR
Triplex
Triplex · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
Llama 3.3 SuperSwallowX 70B Instruct v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
AriannaV2
Gemma · SurgeFF
Params11.9B
Context256K
Q4_K_M7.4 GB
DA
Edentns/DataVortexS-10.7B-dpo-v1.5
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
DA
DataVortexS 10.7B Dpo v1.12
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SW
Swallow 70b RP EX
Swallow · mradermacher
Params69.3B
Context4K
Q4_K_M41.6 GB
QW
ace 0.5b
Qwen · ansh0x
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen3.5 0.8B JP Tuned v1.0
Qwen · CloudGoat
Params773M
Context256K
Q4_K_M0.5 GB
TE
T.E 8.1
mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
PL
PlatYi 34B Q i1
Platyi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
KO
KOS V4 Instruct
Kos · Kentucky-Open-Science
Params3.02B
Context64K
Q4_K_M1.8 GB
11
111m i1
mradermacher
Params111M
Context2K
Q4_K_M0.1 GB
ME
MemoChat Vicuna 7B
Memochat · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
SA
Sakura SOLRCA Math Instruct DPO v2
Sakura · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
OU
Oute Tts
Oute · mradermacher
Params1.25B
Context128K
Q4_K_M0.8 GB
LL
Llama 3 Soliloquy 8B v2
Llama · RichardErkhov
Params8.03B
Context24K
Q4_K_M4.9 GB
GE
gemma 4 E4B it latex copyedit
Gemma · michelinolinolino
Params7.52B
Context128K
Q4_K_M5.3 GB
LL
Llama 3.1 Spellbound StoryWriter 70b instruct 0.4 16bit
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB