GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
PL
PlatYi 34B 200k Q FastChat
Platyi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
MO
mohomin123 M DIE M 10.7B
Mohomin · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
HY
Hypernova 2x12B exp i1
Hypernova · mradermacher
Params21.1B
Context128K
Q4_K_M12.8 GB
LU
Lunar 10.7B i1
Lunar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
KO
LN Korean 14B v0.1 i1
Korean · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
LL
youjunhyeok/llama3-koen-sft-dpo-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
Sakura SOLAR
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
Llama2 13b Dpo v3
Llama · RichardErkhov
Params13.2B
Context4K
Q4_K_M8.0 GB
HY
Hypernova 2x12B exp
Hypernova · mradermacher
Params21.1B
Context128K
Q4_K_M12.8 GB
GE
Gemma 4 E4B it Minecraft MT en zh v0.1
Gemma · Q1ngMang
Params7.52B
Context128K
Smallest8.0 GB
LL
Llama 3.3 SuperSwallowX 70B RP v0.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
CO
Merged
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
KI
Kinyarwanda Tts 1b Full
Kinyarwanda · mradermacher
Params1.25B
Context128K
Q4_K_M0.8 GB
SA
XO
Saberbx · saberbx
Params3.21B
Context128K
Smallest2.6 GB
AI
Ailo152m events en
Ailo · xxrickyxx
Params152M
Context512
Q4_K_M0.1 GB
DA
DataVortexS 10.7B Dpo v1.2
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
OP
OpenLlama Platypus 3B
Openllama · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
LL
hf 100 Llama 3 Spellbound Instruct 8B 0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
StopCarbon 10.7B v4
Stopcarbon · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
PH
EduRABSA_SLM_v1_SLERP_phi4mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
MI
Ko Mixtral v1.3
Mistral · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
ED
EduRABSA_SLM_v1_SLERP_qw2.5 1.5B
Edurabsa · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
SA
Sakura GalTransl 7B v3.7
Sakura · Nayuta20251106
Params7.72B
Context128K
Smallest4.3 GB
DA
DataVortexS 10.7B v0.2
Datavortexs · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
CA
CarbonVillain En 10.7B v3
Carbonvillain · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
CU
Custom KoLLM 13B v7
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
JA
JAD S1 7B A1B EarlyPreview
Jad · DreamBlooms
Params7.36B
Context8K
Smallest7.8 GB
OO
OOM 13B 01 i1
Oom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
SO
solar 10.7b merged v0.1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SP
splade v3
Splade · cstr
Params110M
Context—
Smallest0.1 GB