GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
DA
DataVortexS 10.7B Dpo v1.2
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
SP
splade disco human
Splade · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
DA
DataVortexS 10.7B v0.3
Datavortexs · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
ME
MermaidSolar i1
Mermaidsolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
CA
CarbonVillain 10.7B v3
Carbonvillain · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
DA
Edentns/DataVortexS-10.7B-dpo-v1.2
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
KO
KOR Orca Platypus 13B v2
Kor · tensorblock
Params13B
Context2K
Smallest4.9 GB
MI
Minerva 3B Instruct v1.0 Q5 K M
Minerva · NikolayKozloff
Params2.89B
Context16K
Smallest2.1 GB
QW
Qwen3 VL 8B Instruct Minecraft MT en zh
Qwen · Q1ngMang
Params8.19B
Context256K
Smallest8.7 GB
PL
PlatYi 34B Q
Platyi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
SA
Sakura GalTransl 7B v3.7
Sakura · chenniandexin
Params7.72B
Context128K
Smallest4.3 GB
ME
megastudyedu M SOLAR 10.7B v1.1 beta
Megastudyedu · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
TW
Twice KoSOLAR 16.1B test
Twice · tensorblock
Params16.1B
Context4K
Smallest6.0 GB
CA
CarbonVillain En 10.7B v2
Carbonvillain · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
llama2_koen_13b_SFTtrain
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
FA
OpenLLM France Claire 7B 0.1
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
DA
DataVortexS 10.7B Dpo v1.6
Datavortexs · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
CO
COKAL DPO 13b v2
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
LL
Llama-3-Soliloquy-8B-v2
Llama · SolidSnacke
Params8.03B
Context8K
Q4_K_M4.9 GB
PL
PlatYi 34B 200k Q FastChat
Platyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
MP
mpt-7b-8k-chat
Mpt · maddes8cht
Params6.86B
Context8K
Q4_K_M4.4 GB
NL
NLPark/Test1_SLIDE
Nlpark · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
pub llama 13B v6
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
KO
LN Korean 14B v0.2
Korean · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
SO
SOLAR Platypus 10.7B v1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
Claire Mistral 7B 0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
COKAL DPO test v2 13b
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
CU
PracticeLLM Custom KoLLM 13B v5
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
CT
Ctxl Rerank v2 Instruct Multilingual 2b
Ctxl · mradermacher
Params2.59B
Context256K
Q4_K_M1.6 GB
PE
PersianMind v1.0 Q8 0
Persianmind · SmartGitiCorp
Params6.82B
Context2K
Smallest7.2 GB