GGUF models: cc-by-nc-nd-4.0 license
334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.
KE
Keiana-L3-Test4.7-8B-3
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
TU
tutunamayanlar V2.0 GPT
Tutunamayanlar · darknight42
Params8.03B
Context8K
Q4_K_M4.9 GB
AK
AkiroXEntro-7B-1-V1
Akiroxentro · Kaoeiri
Params7.25B
Context8K
Smallest5.1 GB
KE
Keiana-L3-Test6.7-8B-23
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest5.7 GB
MA
Magneslimum 12B V0.3 i1
Magneslimum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral 7B Instruct v0.2
Mistral · matrixportalx
Params7.24B
Context32K
Smallest5.1 GB
MI
Mistral 7B wikipedia de v1
Mistral · MR-Eder
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
luvorae qwen2.5 1.5b mgd Q4 K M
Qwen · luvorae
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
luvorae qwen2.5 1.5b mgd Q5 K M
Qwen · luvorae
Params1.54B
Context32K
Smallest1.1 GB
TA
Talkia Q8 0
Talkia · ShihteSiao
Params8.19B
Context40K
Smallest8.7 GB
QW
Qwen3 4B Fine TOONed
Qwen · praiselab-picuslab
Params4.02B
Context40K
Smallest4.3 GB
AK
AkiroXEntrou-4x7B
Akiroxentrou · Kaoeiri
Params24.2B
Context8K
Q4_K_M14.6 GB
BI
BioMistral BioMistral MedMNX
Biomistral · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
SC
C2S Scale Pythia 1b Pt
Scale · joshloecker
Params1.01B
Context8K
Smallest1.1 GB
AK
Akshar Nano V2
Akshar · shreyaschavan11
Params1.24B
Context128K
Q4_K_M0.8 GB
SU
SuperThetaMaven 4.0
Superthetamaven · jefferylovely
Params7.24B
Context32K
Smallest4.4 GB
SH
Shi Ci_v3 Robin
Shi · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
JS
JSL MedLlama 3 8B v2.0 Q4 K M
Jsl · iliajamasb
Params8.03B
Context8K
Q4_K_M4.9 GB
AG
Aguie v0.1
Aguie · tensorblock
Params13.3B
Context2K
Smallest5.0 GB
SH
Shi Ci_v3 Robin
Shi · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
KE
Keiana-L3-Test6.1-8B-17
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
MA
Magneslimum 12B V0.3
Magneslimum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
KA
Kaoeiri Keiana L3 Test5.75 8B 13.5
Kaoeiri · RichardErkhov
Params8.03B
Context8K
Smallest3.2 GB
MA
L3MaidRPKraiKei-V1.6-8B
Maidrpkraikei · Kaoeiri
Params8.03B
Context8K
Smallest5.7 GB
JS
JSL MedMNX 7B
Jsl · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
MA
MS MagpantheonselRP 22B 12.9 Fictional Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
TI
TIPO 200M dev
Tipo · KBlueLeaf
Params203M
Context2K
Smallest0.2 GB
DP
ME Dpo 7B v1.1
Dpo · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
qwen3.8 9b hsft v2
Qwen · misthemAI
Params9.2B
Context256K
Q4_K_M5.8 GB
KE
Keiana L3 Test5.4 8B 10 Q6 K
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB