GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LA
Emojet v2
Laya · subhadeep3902
Params398M
Context8K
Q4_K_M0.3 GB
CodingEmbedding
DR
DRT O1 7B
Drt · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
PL
Platypus2 7B
Platypus · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
SA
Kyujinpy Sakura SOLRCA Math Instruct DPO v1
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
MI
Claire Mistral 7B 0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VO
Vocaela 500M
Vocaela · vocaela
Params409M
Context8K
Smallest0.4 GB
Vision
MI
DopeorNope Ko Mixtral MoE 7Bx2
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
QW
Sakura 14B Qwen2beta v0.9.1
Qwen · SakuraLLM
Params14.2B
Context32K
Smallest5.9 GB
GGUF
OR
orca mini 3b
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
KO
KoT Platypus2 13B
Kot · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
ME
MermaidSolar
Mermaidsolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SW
Swallow 70b RP EX
Swallow · mradermacher
Params69.3B
Context4K
Q4_K_M41.6 GB
Roleplay
DA
DataVortexM 7B Instruct v0.1
Datavortexm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
PlatYi 34B Llama Q v2
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
MI
Wizard Mixtral 8x22B Instruct v0.1 i1
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
GGUF
QW
Sakura 32B Qwen2beta v0.9.1
Qwen · SakuraLLM
Params32.5B
Context32K
Smallest12.2 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.0
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
VO
Vocence Tts v19
Vocence · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
DA
DataVortexS 10.7B Dpo v1.2
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
jjourney1125/M-SOLAR-10.7B-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
PracticeLLM SOLAR Tail 10.7B Instruct v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.2
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
PA
AIFT/PACK-13b-v1.1
Pack · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
ROLEPL AI v2 Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
RoleplayTool use
LL
bineric NorskGPT Llama3 8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DI
M DIE M 10.7B
Die · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SA
Sakura SOLRCA Instruct DPO
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.5
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
DA
DataVortexM 7B Instruct v0.1
Datavortexm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
OR
orca mini v2 7b
Orca · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF

Keep browsing