GGUF models: cc-by-nc-nd-4.0 license

334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
KE
Keiana-L3-Test4.7-8B-3
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
TU
tutunamayanlar V2.0 GPT
Tutunamayanlar · darknight42
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AK
AkiroXEntro-7B-1-V1
Akiroxentro · Kaoeiri
Params7.25B
Context8K
Smallest5.1 GB
GGUF
KE
Keiana-L3-Test6.7-8B-23
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest5.7 GB
GGUF
MA
Magneslimum 12B V0.3 i1
Magneslimum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · matrixportalx
Params7.24B
Context32K
Smallest5.1 GB
GGUF
MI
Mistral 7B wikipedia de v1
Mistral · MR-Eder
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
luvorae qwen2.5 1.5b mgd Q4 K M
Qwen · luvorae
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
QW
luvorae qwen2.5 1.5b mgd Q5 K M
Qwen · luvorae
Params1.54B
Context32K
Smallest1.1 GB
Tool use
TA
Talkia Q8 0
Talkia · ShihteSiao
Params8.19B
Context40K
Smallest8.7 GB
ReasoningTool use
QW
Qwen3 4B Fine TOONed
Qwen · praiselab-picuslab
Params4.02B
Context40K
Smallest4.3 GB
GGUF
AK
AkiroXEntrou-4x7B
Akiroxentrou · Kaoeiri
Params24.2B
Context8K
Q4_K_M14.6 GB
GGUF
BI
BioMistral BioMistral MedMNX
Biomistral · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SC
C2S Scale Pythia 1b Pt
Scale · joshloecker
Params1.01B
Context8K
Smallest1.1 GB
GGUF
AK
Akshar Nano V2
Akshar · shreyaschavan11
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
SU
SuperThetaMaven 4.0
Superthetamaven · jefferylovely
Params7.24B
Context32K
Smallest4.4 GB
GGUF
SH
Shi Ci_v3 Robin
Shi · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
JS
JSL MedLlama 3 8B v2.0 Q4 K M
Jsl · iliajamasb
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AG
Aguie v0.1
Aguie · tensorblock
Params13.3B
Context2K
Smallest5.0 GB
GGUF
SH
Shi Ci_v3 Robin
Shi · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
GGUF
KE
Keiana-L3-Test6.1-8B-17
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
MA
Magneslimum 12B V0.3
Magneslimum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KA
Kaoeiri Keiana L3 Test5.75 8B 13.5
Kaoeiri · RichardErkhov
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MA
L3MaidRPKraiKei-V1.6-8B
Maidrpkraikei · Kaoeiri
Params8.03B
Context8K
Smallest5.7 GB
GGUF
JS
JSL MedMNX 7B
Jsl · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
MA
MS MagpantheonselRP 22B 12.9 Fictional Q4 K M
Magpantheonselrp · Kaoeiri
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
TI
TIPO 200M dev
Tipo · KBlueLeaf
Params203M
Context2K
Smallest0.2 GB
Vision
DP
ME Dpo 7B v1.1
Dpo · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
qwen3.8 9b hsft v2
Qwen · misthemAI
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
KE
Keiana L3 Test5.4 8B 10 Q6 K
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF

Keep browsing