GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
CR
Cran May T.E 8.1
Cran · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
ME
MermaidSolar Q8 0
Mermaidsolar · danielus
Params10.7B
Context4K
Smallest11.4 GB
MK
MKLLM 7B Instruct Q4 K M
Mkllm · cigol123
Params7.24B
Context32K
Q4_K_M4.4 GB
PL
Ko PlatYi 6B gu
Platyi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
PL
Ko PlatYi 6B
Platyi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
LL
PlatYi 34B Llama Q
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
ME
MermaidSolar Q6 K
Mermaidsolar · danielus
Params10.7B
Context4K
Smallest8.8 GB
DR
DRT O1 8B
Drt · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
CL
Claire 7B FR Instruct 0.1 gguf q4 k m
Claire · keisuke-miyako
Params6.92B
Context2K
Q4_K_M4.8 GB
KU
Kurugai EEVE v1.1
Kurugai · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
CT
ctxl rerank v2 instruct multilingual 1b gguf q4 k m
Ctxl · keisuke-miyako
Params1.33B
Context40K
Q4_K_M0.9 GB
SA
Sakura 7B LNovel v0.9
Sakura · MingZi1
Params7.72B
Context32K
Q4_K_M4.9 GB
OR
orca_mini_3b
Orca · SansarK
Params3.43B
Context2K
Smallest2.1 GB
MK
MKLLM-7B-Instruct
Mkllm · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
CT
ctxl rerank v2 instruct multilingual 1b gguf q8 0
Ctxl · keisuke-miyako
Params1.33B
Context40K
Smallest1.4 GB
LL
Taigi Llama 2 Chat 13B
Llama · Bohanlu
Params13.3B
Context4K
Q4_K_M8.0 GB
LL
tuxsentience beta2
Llama · GrainWare
Params1.24B
Context128K
Q4_K_M0.8 GB
ME
Medit Xl
Medit · yrrhall
Params8M
Context—
Smallest0.0 GB
ME
MermaidSolar Q5 K M
Mermaidsolar · danielus
Params10.7B
Context4K
Smallest7.6 GB
LL
Llama 3.1 Sherkala 8B Chat
Llama · chambette
Params8.29B
Context8K
Q4_K_M5.1 GB
BR
Breeze-ASR-26
Breeze · m45801ch
Params1.54B
Context—
Smallest1.7 GB
TR
trickcal sen2epica
Trickcal · MayoIsJS
Params125M
Context1K
Smallest0.3 GB
SA
Sakura 7B LNovel v0.9
Sakura · rereefewf
Params7.72B
Context32K
Q4_K_M4.9 GB
DA
DataVortexS 10.7B v0.2
Datavortexs · RichardErkhov
Params10.9B
Context4K
Smallest4.1 GB
LL
OuteAI_Llama OuteTTS 1.0 1B
Llama · Imaginare
Params1.25B
Context128K
Smallest0.6 GB
KO
kyujinpy Kosy platypus2 13B v3
Kosy · tensorblock
Params13B
Context2K
Smallest4.9 GB
ON
OneKE Q8 0
Oneke · caixiaomu
Params13.3B
Context4K
Smallest14.1 GB
SO
SOLARC M 10.7B
Solarc · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
MK
MKLLM 7B Instruct Q4 K S
Mkllm · cigol123
Params7.24B
Context32K
Smallest4.1 GB
DA
DataVortexM 7B Instruct v0.1
Datavortexm · RichardErkhov
Params7.24B
Context32K
Smallest2.7 GB