GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
LA
Emojet v2
Laya · subhadeep3902
Params398M
Context8K
Q4_K_M0.3 GB
DR
DRT O1 7B
Drt · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
PL
Platypus2 7B
Platypus · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
SA
Kyujinpy Sakura SOLRCA Math Instruct DPO v1
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
MI
Claire Mistral 7B 0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
VO
Vocaela 500M
Vocaela · vocaela
Params409M
Context8K
Smallest0.4 GB
MI
DopeorNope Ko Mixtral MoE 7Bx2
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
QW
Sakura 14B Qwen2beta v0.9.1
Qwen · SakuraLLM
Params14.2B
Context32K
Smallest5.9 GB
OR
orca mini 3b
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
KO
KoT Platypus2 13B
Kot · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
ME
MermaidSolar
Mermaidsolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SW
Swallow 70b RP EX
Swallow · mradermacher
Params69.3B
Context4K
Q4_K_M41.6 GB
DA
DataVortexM 7B Instruct v0.1
Datavortexm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
PlatYi 34B Llama Q v2
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
MI
Wizard Mixtral 8x22B Instruct v0.1 i1
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
QW
Sakura 32B Qwen2beta v0.9.1
Qwen · SakuraLLM
Params32.5B
Context32K
Smallest12.2 GB
DA
DataVortexS 10.7B Dpo v1.0
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
VO
Vocence Tts v19
Vocence · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
DA
DataVortexS 10.7B Dpo v1.2
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
jjourney1125/M-SOLAR-10.7B-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
PracticeLLM SOLAR Tail 10.7B Instruct v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
DA
DataVortexS 10.7B Dpo v1.2
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
PA
AIFT/PACK-13b-v1.1
Pack · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
QW
ROLEPL AI v2 Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
LL
bineric NorskGPT Llama3 8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
DI
M DIE M 10.7B
Die · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SA
Sakura SOLRCA Instruct DPO
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
DA
DataVortexS 10.7B Dpo v1.5
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
DA
DataVortexM 7B Instruct v0.1
Datavortexm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
OR
orca mini v2 7b
Orca · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB