GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
DataVortexS 10.7B Dpo v1.2
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SP
splade disco human
Splade · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
GGUF
DA
DataVortexS 10.7B v0.3
Datavortexs · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
ME
MermaidSolar i1
Mermaidsolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CA
CarbonVillain 10.7B v3
Carbonvillain · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
DA
Edentns/DataVortexS-10.7B-dpo-v1.2
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KOR Orca Platypus 13B v2
Kor · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
MI
Minerva 3B Instruct v1.0 Q5 K M
Minerva · NikolayKozloff
Params2.89B
Context16K
Smallest2.1 GB
GGUF
QW
Qwen3 VL 8B Instruct Minecraft MT en zh
Qwen · Q1ngMang
Params8.19B
Context256K
Smallest8.7 GB
Tool useVision
PL
PlatYi 34B Q
Platyi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
SA
Sakura GalTransl 7B v3.7
Sakura · chenniandexin
Params7.72B
Context128K
Smallest4.3 GB
GGUF
ME
megastudyedu M SOLAR 10.7B v1.1 beta
Megastudyedu · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TW
Twice KoSOLAR 16.1B test
Twice · tensorblock
Params16.1B
Context4K
Smallest6.0 GB
GGUF
CA
CarbonVillain En 10.7B v2
Carbonvillain · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
llama2_koen_13b_SFTtrain
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
FA
OpenLLM France Claire 7B 0.1
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.6
Datavortexs · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
CO
COKAL DPO 13b v2
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
LL
Llama-3-Soliloquy-8B-v2
Llama · SolidSnacke
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PL
PlatYi 34B 200k Q FastChat
Platyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
MP
mpt-7b-8k-chat
Mpt · maddes8cht
Params6.86B
Context8K
Q4_K_M4.4 GB
GGUF
NL
NLPark/Test1_SLIDE
Nlpark · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
pub llama 13B v6
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
KO
LN Korean 14B v0.2
Korean · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
SO
SOLAR Platypus 10.7B v1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
Claire Mistral 7B 0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
COKAL DPO test v2 13b
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
CU
PracticeLLM Custom KoLLM 13B v5
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
CT
Ctxl Rerank v2 Instruct Multilingual 2b
Ctxl · mradermacher
Params2.59B
Context256K
Q4_K_M1.6 GB
CodingEmbeddingReasoning
PE
PersianMind v1.0 Q8 0
Persianmind · SmartGitiCorp
Params6.82B
Context2K
Smallest7.2 GB
GGUF

Keep browsing