GGUF models: cc-by-nc-nd-4.0 license
334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.
CO
Ajibawa 2023 Code 13B
Code · tensorblock
Params13B
Context4K
Smallest4.9 GB
NE
neutts nano plt
Neutts · mimba
Params229M
Context2K
Smallest0.2 GB
RI
ME 7B v1.1
Richarderkhov · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Hedoneo L3.1 8B v1.2 Q8 0
Hedoneo · Kaoeiri
Params8.03B
Context8K
Smallest8.5 GB
KE
Keiana-L3-Test6.25-8B-18.5
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
AI
AiMaven Merkaba 2.0 Q4 K M
Aimaven · jefferylovely
Params7.24B
Context32K
Q4_K_M4.4 GB
PO
Polyglot 8x7b v0.1
Polyglot · macadeliccc
Params46.7B
Context32K
Smallest49.6 GB
AK
AkiroXEntro-7B-1-V1
Akiroxentro · mradermacher
Params7.25B
Context8K
Q4_K_M4.4 GB
SC
C2S Scale Pythia 1b Pt
Scale · joshloecker
Params1.01B
Context8K
Q4_K_M0.7 GB
MA
MarioMaven.Q4 K
Mariomaven · jefferylovely
Params7.24B
Context32K
Smallest4.4 GB
GP
dutybot
gpt-oss · EryriLabs
Params20.9B
Context128K
Q4_K_M15.8 GB
CO
Ajibawa 2023 Code 33B
Code · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
JS
JSL MedLlama 3 8B v2.0 Q6 K
Jsl · Axcel1
Params8.03B
Context8K
Smallest6.6 GB
ON
OncoReasoning 0526
Oncoreasoning · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
MO
Motacilla cinerea
Motacilla · Cran-May
Params7.62B
Context128K
Smallest5.8 GB
XV
xVerify 32B I
Xverify · ggbetz
Params32.8B
Context32K
Smallest34.8 GB
AK
Akshar Nano
Akshar · shreyaschavan11
Params1.24B
Context128K
Q4_K_M0.8 GB
KE
Keiana-L3-Test5.8-8B-14
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
NL
P E4
Nlpark · NLPark
Params7.62B
Context128K
Smallest4.7 GB
GE
Gemma3 4B Fine TOONed
Gemma · praiselab-picuslab
Params3.88B
Context128K
Smallest4.1 GB
MI
Mistral 7B Instruct v0.2
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
SL
Ajibawa 2023 SlimOrca 13B
Slimorca · tensorblock
Params13B
Context4K
Smallest4.9 GB
GO
GOIDA-0.5B
Goida · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
JS
JSL MedLlama 3 8B v2.0 Q4 K M
Jsl · mannha
Params8.03B
Context8K
Q4_K_M4.9 GB
KE
Keiana-L3-Test6.2-8B-18
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
KE
Keiana-L3-Test5.2-8B-8
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
MI
ME MISTRAL 7B v1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
VE
Velara 11B V2
Velara · tensorblock
Params11.4B
Context32K
Smallest4.2 GB
SH
Shi Ci_v3 Robin
Shi · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
TA
Talkia n8n Q8 0
Talkia · ShihteSiao
Params8.19B
Context40K
Smallest8.7 GB